-- Logs begin at Tue 2022-08-30 23:30:47 UTC, end at Wed 2022-08-31 00:39:17 UTC. -- Aug 31 00:11:40.105586 dv-cinder-852210-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 00:11:40.114457 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 00:11:40.116361 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:11:40 2022] *** Aug 31 00:11:40.116361 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:11:40.116361 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:11:40.116361 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: nodename: dv-cinder-852210-5-iscsi Aug 31 00:11:40.116361 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: machine: x86_64 Aug 31 00:11:40.116361 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: clock source: unix Aug 31 00:11:40.116361 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: pcre jit disabled Aug 31 00:11:40.116361 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: detected number of CPU cores: 4 Aug 31 00:11:40.116361 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: current working directory: / Aug 31 00:11:40.116361 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:11:40.117095 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: your processes number limit is 47680 Aug 31 00:11:40.117095 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: your memory page size is 4096 bytes Aug 31 00:11:40.117095 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: detected max file descriptor number: 2048 Aug 31 00:11:40.117095 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: lock engine: pthread robust mutexes Aug 31 00:11:40.117095 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: thunder lock: enabled Aug 31 00:11:40.117095 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 00:11:40.117509 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:11:40.156659 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: Python main interpreter initialized at 0x55c50d8fc9c0 Aug 31 00:11:40.156659 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: python threads support enabled Aug 31 00:11:40.156659 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: your server socket listen backlog is limited to 100 connections Aug 31 00:11:40.156659 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:11:40.157007 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:11:40.157090 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: *** Operational MODE: preforking *** Aug 31 00:11:40.157314 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:11:40.157314 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: spawned uWSGI master process (pid: 112107) Aug 31 00:11:40.157507 dv-cinder-852210-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 00:11:40.159381 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: spawned uWSGI worker 1 (pid: 112108, cores: 1) Aug 31 00:11:40.159381 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: spawned uWSGI worker 2 (pid: 112109, cores: 1) Aug 31 00:11:40.159381 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:11:40.819110 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:11:40.843441 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:11:41.911341 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:11:41.911341 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: from cryptography.utils import int_from_bytes Aug 31 00:11:41.911985 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:11:41.911985 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: from cryptography.utils import int_from_bytes Aug 31 00:11:41.934561 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:11:41.934561 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: from cryptography.utils import int_from_bytes Aug 31 00:11:41.935150 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:11:41.935150 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: from cryptography.utils import int_from_bytes Aug 31 00:11:44.406468 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:11:44.407144 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:11:44.407246 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:11:44.407566 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:11:44.407666 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:11:44.408029 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:11:44.408103 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:11:44.408219 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.408405 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:11:44.408513 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.408764 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:11:44.408869 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.409016 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:11:44.409113 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.409397 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.409495 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.409949 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.410048 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.410262 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.410364 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.410570 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.410670 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.410887 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.410987 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.411137 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.411242 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.411445 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.411547 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.411762 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-5-iscsi {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.411853 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.412076 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.412192 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.412370 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.412469 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.412681 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.412776 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.413018 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.413120 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-5-iscsi {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.413375 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.414021 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.414179 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.414346 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.414497 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.414646 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.414804 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.415071 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.415216 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.415389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.416364 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.416514 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.416654 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.416654 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.416909 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.417057 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.417192 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.417192 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.417445 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.417568 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.417700 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.417700 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.417965 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.418109 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.418242 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.418375 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.418507 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.418643 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.418777 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.418777 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.419036 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-5-iscsi {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.419169 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.419293 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.419419 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.419533 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.419533 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.419791 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-5-iscsi {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.419919 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.420048 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.420191 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.420318 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.420545 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.420685 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.420813 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.420937 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.421086 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.421238 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.421374 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.421511 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.421685 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.421822 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.421995 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.422127 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.422299 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.422434 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.422608 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.422738 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.422902 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.423041 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.423185 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.423313 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.423485 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.423626 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.423796 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.423927 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.424092 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.424257 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.424496 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.424650 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.424777 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.424912 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.425040 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.425166 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.425298 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.425436 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.425573 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.425701 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.425834 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.425959 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.426096 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.426230 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.426346 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.426461 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.426591 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.426748 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.426897 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.427037 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.427172 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.427300 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.427434 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.427572 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.427729 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.427867 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.428027 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.428180 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.428363 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.428508 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.428644 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.428777 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.428965 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.429108 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.429264 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.429394 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.429574 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.429706 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.429877 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.430007 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.430187 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.430326 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.430488 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.430626 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.430797 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.430933 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.431114 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.431256 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.431394 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.431527 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.431693 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.431825 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.432021 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.432172 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.432363 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.432494 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.432666 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.432806 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.432973 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.433103 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.433282 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.433421 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.433582 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.433714 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.433879 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.434010 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.434175 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.434316 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.434485 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.434699 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.434844 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.434972 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.435141 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.435315 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.435315 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.435574 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.435708 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.435835 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.435962 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.436104 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.436299 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.436442 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.436572 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.436704 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.436837 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.436975 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.437103 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.437239 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.437375 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.437510 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.437638 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.437771 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.437899 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.438038 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.438167 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.438299 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.438433 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.438566 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.438710 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.438838 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.439001 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.439140 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.439295 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.439431 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.439592 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.439724 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.439886 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.440023 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.440214 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.440358 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.440526 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.440671 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.440807 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.440933 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.441106 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.441248 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.441385 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.441513 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.441685 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.441826 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.441995 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.442132 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.442275 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.442409 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.442575 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.442719 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.442886 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.443017 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.443182 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.443313 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.443475 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.443612 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.443784 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.443915 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.444125 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.444282 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.444422 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.444567 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.444712 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.444912 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.445042 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.445307 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.445439 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.445572 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.445700 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.445836 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.445965 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.446091 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.446224 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.446352 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.446491 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.446643 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.446773 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.446937 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.447075 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.447238 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.447369 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.447528 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.447666 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.447822 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.447961 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.448100 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.448315 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.448447 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.448574 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.448710 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.448843 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.449001 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.449141 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.449296 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.449432 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.449592 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.449724 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.449901 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.450044 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.450205 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.450335 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.450507 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.450639 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.450808 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.450952 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.451121 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:11:44.451252 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.451453 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.451583 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.451772 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.451911 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.452082 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.452243 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.452417 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.452548 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.452721 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.452858 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.453037 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.453176 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.453341 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.453472 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.453643 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.453775 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.453944 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.454083 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.454254 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.454385 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.454563 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.454701 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.454869 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.455078 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.455202 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.455361 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.455504 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.455619 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.455779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.455895 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.456107 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.456529 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.456669 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.456808 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.456961 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.457126 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.457245 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.457385 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.457505 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.457643 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.457759 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.458018 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.458156 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.458294 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.458575 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.458705 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.458958 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.459159 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.459317 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.459451 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.459579 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.459812 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.459962 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.461043 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.461256 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.461396 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.461543 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.461543 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.461869 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.461972 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.462108 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.462246 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.462440 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.462553 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.462748 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.462892 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.463129 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.463294 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.463452 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.463616 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.463832 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.463999 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.464119 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.464321 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.464452 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.464606 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.464883 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.465004 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.465231 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.465350 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.465468 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.465612 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.465777 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.466059 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.466318 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.466502 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.466617 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.466745 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.466862 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.466999 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.467255 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.467465 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.467577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.467710 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.467852 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.468144 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.468374 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.468511 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.468657 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.468846 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.468960 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.469097 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.469337 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.469512 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.469751 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.469940 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.469940 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.470169 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.470304 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.470533 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.470768 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.470880 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.471007 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.471134 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.471417 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.471660 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.471784 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.471911 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.472047 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.472332 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.472493 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.472644 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.472821 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.472938 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.473252 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.473391 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.473633 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.473822 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.473939 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.474067 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.474198 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.474456 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.474642 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.474759 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.474894 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.475060 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.475317 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.475441 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.475648 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.476536 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.476765 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.476970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.477089 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.477431 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.477583 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.477721 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.477833 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.477990 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.478233 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.478412 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.478663 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.478941 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.479086 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.479208 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.479345 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.479500 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.479755 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.479873 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.480001 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.480122 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.480274 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.480530 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.480693 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.480831 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.480951 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.481061 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.481345 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.481505 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.481745 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.481943 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.482070 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.482207 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.482325 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.482510 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.482732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.482933 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.483072 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.483192 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.483404 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.483553 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.483810 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.483937 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.484077 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.484422 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.484567 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.484567 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.484974 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.485110 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.485252 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.485382 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.485591 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.485750 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.485890 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.486021 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.486271 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.486457 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.486585 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.486715 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.486865 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.487210 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.487404 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.487404 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.487660 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.487844 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.487979 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.488105 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.488363 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.488530 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.488698 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.488810 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.488968 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.489176 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.489383 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.489562 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.489691 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.489874 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.490079 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.490195 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.490337 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.490449 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.490687 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.490900 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.491034 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.491164 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.491401 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.491547 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.491796 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.492089 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.492286 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.492497 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.492844 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.493076 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.493340 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.493464 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.493599 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.493798 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.493958 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.494068 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.497836 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.498030 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.498312 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.498567 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.498703 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.498917 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.499083 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.499083 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.499498 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.499738 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.499920 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.500174 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.500307 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.500557 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.500698 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.500809 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.500938 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.501049 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.501299 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.501422 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.501533 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.501641 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.501750 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.501875 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.502042 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.502286 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.502286 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.502507 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.502615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.502749 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.502874 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.502874 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.503209 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.503448 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.503583 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.503823 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.503823 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.504073 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.504229 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.504345 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.504585 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.504585 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.504977 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.505110 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.505220 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.505329 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.505437 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.505688 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.505688 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.506043 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.506156 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.506263 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.506379 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.506379 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.506621 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.506737 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.506975 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.507199 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.507309 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.507742 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.508029 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.508396 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.508648 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.508787 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.508906 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.508906 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.509149 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.509293 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.509423 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.509533 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.509766 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.509900 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.509900 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.510248 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.510376 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.510376 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.510602 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.510710 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.510965 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.511154 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.511154 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.511372 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.511500 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.511737 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.511925 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.512045 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.512184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.512184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.512410 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.512649 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.512830 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.512940 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.512940 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.513218 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.513335 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.513443 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.513678 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.513829 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.514065 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.514065 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.514300 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.514408 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.514537 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.514802 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.514802 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.515107 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.515217 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.515324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.515550 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.515750 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.516016 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.516239 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.516514 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.516733 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.516858 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.516996 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.517108 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.517108 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.517324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.517537 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.517692 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.517931 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.517931 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.518169 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.518373 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.518373 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.518735 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.518875 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.519004 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.519132 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.519132 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.519380 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.519515 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.519652 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.519789 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.519917 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.520052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.520052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.520325 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.520468 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.520606 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.520733 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.520862 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.521001 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.521130 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.521268 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.521404 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.521533 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.521669 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.521797 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.521934 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.522071 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.522200 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.522327 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.522327 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.522567 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.522567 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.523575 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.523575 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.523810 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.523919 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.524057 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.524218 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.524359 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.524488 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.524617 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.524744 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.524872 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.525012 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.525142 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.525271 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.525399 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.525526 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.525662 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.525800 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.525939 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.526076 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.526204 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.526331 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.526472 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.526602 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.526730 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.526857 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.526984 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.527112 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.527238 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.527346 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.527485 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.527621 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.527750 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.527876 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.528013 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.528142 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.528331 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.528555 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.528695 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.528837 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.528967 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.529094 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.529224 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.529360 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.529489 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.529626 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.529754 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.529881 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.529881 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.530131 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.530259 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.530466 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.530596 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.530724 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.530858 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.530858 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.531113 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.531251 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.531389 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.531517 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.531645 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.531787 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.531929 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.532057 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.532224 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.532357 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.532493 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.532629 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.532758 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.532894 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.533036 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.533165 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.533293 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.533422 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.533550 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.533696 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.533825 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.533953 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.534080 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.534208 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.534374 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.534517 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.534935 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.535076 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.535302 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.535442 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.535573 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.535715 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.535844 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.535973 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.536124 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.536274 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.536460 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.536605 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.536754 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.536883 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.537066 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.537196 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.537374 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.537512 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.537674 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.537806 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.537980 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.538119 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.538276 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.538454 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.539276 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.539502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.539674 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.539795 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.539932 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.540060 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.540243 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.540374 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.540514 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.540650 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.540800 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.540931 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.541059 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.541186 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.541314 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.541451 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.541580 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.541720 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.541850 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.542008 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.542141 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.542310 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.542442 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.542609 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.542750 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.542921 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.543052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.543225 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.543365 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.543537 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.543676 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.543846 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.543989 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.544171 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.544322 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.544483 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.544617 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.544791 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.544931 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.545098 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.545228 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.545404 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.545545 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.545705 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.545848 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.546012 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.546143 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.546316 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.546447 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.546625 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.546766 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.546925 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.547058 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.547224 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.547355 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.547525 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.547665 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.547834 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.547966 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.548139 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.548300 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.548465 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.548596 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.548774 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.548917 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.549078 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.549225 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.549433 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.549564 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.549692 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.549820 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.549962 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.550103 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.550244 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.550373 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.550558 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.550693 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.550863 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.550993 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.551167 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.551299 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.551473 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.551605 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.551780 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.551921 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.552087 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.552240 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.552417 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.552561 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.552704 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.552841 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.553009 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.553142 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.553308 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.553439 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.553604 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.553744 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.553944 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.554079 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.554266 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.554381 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.554597 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.554742 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.554871 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.554999 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.555160 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.555292 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.555464 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.555595 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.555763 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.555900 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.556065 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.556226 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.556433 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.556566 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.556694 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.556821 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.556975 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.557116 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.557278 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.557419 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.557583 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.557716 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.557905 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.558037 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.558213 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.558346 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.558520 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.558653 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.558826 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.558967 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.559129 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.559284 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.559475 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.559606 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.559780 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.559896 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.560139 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.560278 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.560467 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.560567 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.560774 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.560874 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.561091 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.561180 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.561389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.561477 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.561691 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.561790 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.561990 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.562081 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.562297 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.562384 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.562593 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.562682 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.562911 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.563002 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.563222 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.563310 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.563527 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.563618 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.563830 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.563921 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.564166 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.564324 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.564482 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.564630 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.564794 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.564937 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.565116 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.565256 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.565438 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.565575 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.565762 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.565895 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.566064 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.566195 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.566376 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.566503 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.566689 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.566805 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.567050 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.567161 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.567302 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.567430 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.567611 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.567736 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.567922 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.568047 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.568259 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.568375 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.568572 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.568695 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.568882 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.569013 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.569192 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.569329 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.569515 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.569675 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.569829 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.570085 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.570214 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.570404 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.570536 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.570708 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.570854 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.571023 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.571154 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.571326 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.571458 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.571627 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.571773 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.571928 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.572059 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.572261 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.572396 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.572564 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.572709 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.572865 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.573005 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.573183 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.573324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.573484 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.573616 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.573770 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.573913 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.574081 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.574221 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.574383 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.574523 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.574682 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.574815 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.574981 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.575114 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.575299 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.575432 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.575597 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.575763 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.575902 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.576076 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.576303 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.576437 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.576625 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.576758 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.576942 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.577074 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.577247 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.577388 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.577566 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.577699 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.577871 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.578008 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.578172 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.578313 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.578473 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.578606 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.578770 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.578903 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.579092 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.579231 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.579388 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.579518 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.579703 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.579817 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.580031 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.580143 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.580383 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.580524 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.580690 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.580823 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.581018 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.581165 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.581344 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.581477 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.581663 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.581796 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.581975 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.582108 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.582294 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.582435 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.582595 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.582729 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.582893 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.583026 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.583197 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.583329 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.583498 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.583637 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.583800 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.583933 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.584100 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.584269 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.584427 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.584559 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.584728 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.584862 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.585028 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.585689 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.585900 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.586044 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.586275 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.586455 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.586640 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.586773 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.586962 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.587103 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.587269 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.587492 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.587624 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.587819 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.587960 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.588132 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.588295 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.588480 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.588612 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.588785 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.588928 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.589101 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.589232 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.589406 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.589529 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.589716 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.589935 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.590070 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.590198 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.590326 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.590441 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.590623 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.590766 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.590930 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.591071 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.591238 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.591369 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.591547 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.591686 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.591856 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.591989 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.592174 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.592308 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.592483 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.592628 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.592794 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.592925 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.593096 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.593228 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.593417 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.593631 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.593772 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.593961 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.594094 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.594277 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.594418 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.594589 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.594721 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.594900 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.595033 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.595213 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.595355 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.595522 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.595732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.595863 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.595997 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.596127 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.596354 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.596487 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.596623 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.596752 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.596881 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.597050 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.597183 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.597371 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.597504 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.597694 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.597827 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.598013 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.598144 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.598334 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.598468 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.598648 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.598780 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.598960 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.599093 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.599272 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.599408 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.599595 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.599735 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.599975 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.600118 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.600337 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.600469 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.600595 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.600732 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.601390 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.601523 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.601642 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.601852 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.602040 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.602190 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.602321 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.602481 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.602623 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.602800 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.602941 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.603114 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.603247 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.603425 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.603565 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.603735 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.603885 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.604047 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.604215 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.604384 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.604517 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.604689 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.604830 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.604999 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.605132 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.605303 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.605443 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.605627 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.605769 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.605937 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.606068 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.606246 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.606384 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.606564 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.606779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.606913 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.607090 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.607223 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.607421 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.607562 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.607750 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.607878 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.608075 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.608199 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.608417 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.608528 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.608729 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.608821 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.609051 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.609142 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.609357 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.609537 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.609671 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.609800 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.609958 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.610189 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.610333 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.610482 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.610612 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.610861 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.611001 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.611169 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.611311 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.611471 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.611604 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.611788 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.611921 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.612093 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.612269 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.612447 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.612647 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.612789 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.612992 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.613135 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.613336 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.613465 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.613614 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.613753 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.613937 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.614078 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.614251 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.614384 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.614556 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.614697 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.614879 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.615024 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.615184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.615323 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.615489 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.615629 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.615801 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.615919 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.616108 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.616258 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.616458 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.616594 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.616744 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.617055 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.617189 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.617358 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.617488 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.617658 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.617799 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.617961 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.618093 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.618262 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.618394 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.618583 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.618737 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.618867 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.618993 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.619171 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.619310 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.619475 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.619608 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.619787 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.619919 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.620089 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.620253 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.620419 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.620517 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.620724 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.620872 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.621024 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.621166 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.621330 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.621469 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.621631 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.621770 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.621934 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.622074 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.622235 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.622368 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.622543 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.622676 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.622847 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.622988 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.623150 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.623379 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.623510 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.623695 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.623836 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.624030 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.624183 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.624385 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.624516 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.624699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.624847 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.625006 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.625138 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.625320 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.625458 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.625624 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.625832 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.625973 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.626102 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.626238 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.626373 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.626528 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.626670 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.626839 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.627076 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.627217 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.627411 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.627543 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.627733 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.627866 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.628035 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.628185 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.628395 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.628541 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.628706 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.628838 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.629010 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.629246 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.629377 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.629596 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.629728 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.629913 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.630052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.630219 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.630371 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.630576 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.630710 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.630852 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.630984 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.631116 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.631258 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.631410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.631543 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.631715 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.631847 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.632040 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.632303 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.632440 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.632570 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.632698 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.632827 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.633106 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.633251 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.633417 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.633550 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.633730 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.633863 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.634036 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.634178 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.634339 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.634471 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.634649 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.634792 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.634954 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.635095 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.635287 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.635425 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.635575 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.635708 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.635882 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.636015 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.636207 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.636345 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.636517 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.636661 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.636804 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.636940 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.637114 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.637257 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.637420 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.637553 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.637726 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.637867 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.638037 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.638170 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.638338 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.638479 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.638647 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.638785 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.638952 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.639085 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.639265 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.639407 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.639570 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.639702 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.639880 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.640013 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.640252 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.640402 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.640583 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.640713 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.640909 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.641010 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.641193 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.641301 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.641498 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.641596 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.641811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.641907 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.642133 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.642240 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.642447 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.642547 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.642758 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.642856 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.643063 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.643160 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.643365 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.643465 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.643667 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.643936 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.644044 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.644296 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.644395 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.644602 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.644693 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.644904 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.644995 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.645205 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.645295 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.645512 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.645602 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.645814 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.645904 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.646114 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.646205 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.646416 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.646551 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.646719 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.646810 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.647023 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.647114 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.647322 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.647422 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.648139 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.648699 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.648699 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.648868 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.648959 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.649056 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.649140 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.649222 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.649403 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.649494 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.649713 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.649815 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.650024 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.650129 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.650337 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.650440 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.650645 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.650741 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.650940 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.651030 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.651242 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.651332 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.651554 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.651659 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.651889 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.651978 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.652226 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.652332 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.652550 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.652641 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.652860 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.652951 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.653176 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.653264 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.653481 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.653569 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.653791 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.653879 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.654103 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.654207 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.654411 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.654500 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.654720 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.654811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.655050 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.655222 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.655355 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.655444 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.655659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.655754 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.655966 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.656085 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.656298 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.656434 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.656662 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.656770 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.656914 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.657065 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.657236 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.657376 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.657558 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.657698 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.657863 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.658023 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.658185 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.658336 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.658499 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.658658 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.658816 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.658970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.659129 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.659303 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.659436 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.659895 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.660020 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.660252 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.660372 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.660585 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.660695 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.660893 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.660992 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.661200 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.661289 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.661507 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.661598 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.661818 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.661909 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.662131 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.662219 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.662440 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.662530 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.662743 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.662838 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.663045 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.663134 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.663980 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.664459 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.664550 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.664633 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.664716 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.664798 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.664880 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.665058 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.665195 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.665367 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.665539 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.665680 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.665853 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.665987 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.666193 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.666283 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.666518 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.666608 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.666830 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.666930 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.667141 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.667231 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.667445 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.667541 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.667686 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:11:44.667777 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.668042 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.668377 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.668682 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.668987 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.669291 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.669624 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.669958 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.670274 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.670602 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.670915 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.671238 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.671547 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.671870 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.672223 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.672544 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.672857 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.673189 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.673499 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.673811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.674125 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.674436 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.674747 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.675059 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.675385 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.675709 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.676017 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.676370 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.676690 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.677013 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.677331 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.677644 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.677975 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.678286 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.678600 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.678940 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.679483 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.679706 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.680024 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.680372 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.680760 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.681010 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.681333 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.681662 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.681989 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.682305 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.682633 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.682960 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.683308 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.683620 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.683964 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.684318 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.684634 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.684943 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.685249 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:11:44.685493 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:11:44.822172 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO dbcounter [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Registered counter for database nova_api Aug 31 00:11:44.840818 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO dbcounter [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Registered counter for database nova_api Aug 31 00:11:44.843646 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_db.sqlalchemy.engines [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:11:44.850155 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writer thread running {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:11:44.860758 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG oslo_db.sqlalchemy.engines [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:11:44.867343 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG dbcounter [-] [112108] Writer thread running {{(pid=112108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:11:44.908226 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.context [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5fd1dd09-69f2-4bc1-8110-3d087c5f7a55(cell1) {{(pid=112109) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:11:44.912319 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:11:44.912793 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:11:44.914377 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:11:44.915191 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:11:44.915636 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:11:44.917717 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:11:44.919703 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO dbcounter [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Registered counter for database nova_cell0 Aug 31 00:11:44.923842 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO dbcounter [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Registered counter for database nova_cell1 Aug 31 00:11:44.924437 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.context [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5fd1dd09-69f2-4bc1-8110-3d087c5f7a55(cell1) {{(pid=112108) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:11:44.928333 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG oslo_concurrency.lockutils [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:11:44.928815 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG oslo_concurrency.lockutils [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:11:44.930506 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG oslo_concurrency.lockutils [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:11:44.931280 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG oslo_concurrency.lockutils [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:11:44.931720 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG oslo_concurrency.lockutils [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:11:44.931912 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_db.sqlalchemy.engines [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:11:44.933141 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_db.sqlalchemy.engines [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:11:44.933832 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG oslo_concurrency.lockutils [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:11:44.935880 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO dbcounter [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Registered counter for database nova_cell0 Aug 31 00:11:44.940724 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writer thread running {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:11:44.941062 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writer thread running {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:11:44.941466 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO dbcounter [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Registered counter for database nova_cell1 Aug 31 00:11:44.949329 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG oslo_db.sqlalchemy.engines [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:11:44.950960 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG oslo_db.sqlalchemy.engines [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:11:44.956947 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG dbcounter [-] [112108] Writer thread running {{(pid=112108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:11:44.959198 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG dbcounter [-] [112108] Writer thread running {{(pid=112108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:11:45.089159 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO dbcounter [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Registered counter for database nova_cell0 Aug 31 00:11:45.097972 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_db.sqlalchemy.engines [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:11:45.103719 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writer thread running {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:11:45.108190 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO dbcounter [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Registered counter for database nova_cell0 Aug 31 00:11:45.116274 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG oslo_db.sqlalchemy.engines [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:11:45.121293 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG dbcounter [-] [112108] Writer thread running {{(pid=112108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:11:45.446027 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: WARNING keystonemiddleware.auth_token [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:11:45.448836 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: WARNING keystonemiddleware.auth_token [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:11:45.453296 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: WARNING keystonemiddleware.auth_token [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:11:45.456405 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: WARNING keystonemiddleware.auth_token [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:11:45.797738 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: WARNING keystonemiddleware.auth_token [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:11:45.803735 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: WARNING keystonemiddleware.auth_token [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:11:45.805747 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: WARNING keystonemiddleware.auth_token [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:11:45.809784 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c50d8fc9c0 pid: 112109 (default app) Aug 31 00:11:45.811707 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: WARNING keystonemiddleware.auth_token [None req-9d6086e5-7bf2-440f-8ac4-c7d5d179c2d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:11:45.811852 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:11:45.813051 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Aug 31 00:11:45.813450 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Wed Aug 31 00:11:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:11:45.816997 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c50d8fc9c0 pid: 112108 (default app) Aug 31 00:13:04.954025 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:04.955060 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 31 00:13:04.955459 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:04.972364 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG dbcounter [-] [112108] Writing DB stats nova_api:SELECT=3 {{(pid=112108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:04.973404 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG dbcounter [-] [112108] Writing DB stats nova_cell0:SELECT=3 {{(pid=112108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:04.975031 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG dbcounter [-] [112108] Writing DB stats nova_cell1:SELECT=3 {{(pid=112108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:04.975800 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG dbcounter [-] [112108] Writing DB stats nova_cell0:SELECT=3 {{(pid=112108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:05.854435 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-cdd14536-453c-4e82-8eef-d6c7f31acdb4 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:05.887070 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-cdd14536-453c-4e82-8eef-d6c7f31acdb4 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.923816 Aug 31 00:13:05.887838 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1292 bytes} [Wed Aug 31 00:13:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:08.340879 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:08.341537 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-27657876-a3c3-4f32-9008-c6d1b0cdf48e None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 31 00:13:08.344790 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:08 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:08.793485 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-8839d7aa-b54a-49c6-a0b9-732a571d65e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "swap": 0, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:08.844615 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-8839d7aa-b54a-49c6-a0b9-732a571d65e2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496964 Aug 31 00:13:08.845251 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:09.275562 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-317761c4-5196-440e-9ea8-8c4b36646047 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:09.286211 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writing DB stats nova_api:SELECT=3 {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:09.287618 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writing DB stats nova_cell0:SELECT=3 {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:09.288833 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writing DB stats nova_cell1:SELECT=3 {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:09.289632 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:09.355939 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-317761c4-5196-440e-9ea8-8c4b36646047 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.499797 Aug 31 00:13:09.356877 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1336 bytes} [Wed Aug 31 00:13:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:11.788288 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-8839d7aa-b54a-49c6-a0b9-732a571d65e2 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:11.789893 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-8839d7aa-b54a-49c6-a0b9-732a571d65e2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002081 Aug 31 00:13:11.790437 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:12.490935 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-9b57f92b-3989-4dc5-9ace-c9e402424ddd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:12.532288 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-9b57f92b-3989-4dc5-9ace-c9e402424ddd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.735476 Aug 31 00:13:12.536723 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:13:12.547122 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-03f0ea09-59ac-494f-907f-6c5443f17175 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:12.585107 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-03f0ea09-59ac-494f-907f-6c5443f17175 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041533 Aug 31 00:13:12.585736 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1336 bytes} [Wed Aug 31 00:13:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:14.986358 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-9b57f92b-3989-4dc5-9ace-c9e402424ddd admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:14.987325 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-9b57f92b-3989-4dc5-9ace-c9e402424ddd admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 31 00:13:14.987889 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:15.402346 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-8efbd9f4-6e16-474b-89e0-ae86a7f473ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "disk": 10, "swap": 0}} {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:15.421828 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-8efbd9f4-6e16-474b-89e0-ae86a7f473ce admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427425 Aug 31 00:13:15.422449 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:13:15.435227 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-3ee05d73-fcc6-4748-9198-fed69b0a9cfd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:15.460643 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-3ee05d73-fcc6-4748-9198-fed69b0a9cfd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029053 Aug 31 00:13:15.461444 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1336 bytes} [Wed Aug 31 00:13:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:17.865199 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-8efbd9f4-6e16-474b-89e0-ae86a7f473ce admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:17.866217 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-8efbd9f4-6e16-474b-89e0-ae86a7f473ce admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Aug 31 00:13:17.866625 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:18.353733 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-5c61785b-7ba0-4cf8-9549-28e341f411a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "ram": 2048}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:18.377033 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-5c61785b-7ba0-4cf8-9549-28e341f411a8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503916 Aug 31 00:13:18.377820 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:18.390252 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-841493d6-1abd-45eb-b24d-f9cf2bf5e3d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:18.416993 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-841493d6-1abd-45eb-b24d-f9cf2bf5e3d1 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030274 Aug 31 00:13:18.417848 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1336 bytes} [Wed Aug 31 00:13:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:20.853040 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-5c61785b-7ba0-4cf8-9549-28e341f411a8 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:20.854388 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-5c61785b-7ba0-4cf8-9549-28e341f411a8 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001907 Aug 31 00:13:20.854888 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:21.321945 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-992f40ed-5740-4475-aad8-8353978003ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:21.341265 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-992f40ed-5740-4475-aad8-8353978003ca admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479527 Aug 31 00:13:21.341997 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:21.354802 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-69e5bea4-de07-414a-99b8-c3b6bd90cdb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:21.378352 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-69e5bea4-de07-414a-99b8-c3b6bd90cdb8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027654 Aug 31 00:13:21.379189 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1336 bytes} [Wed Aug 31 00:13:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:23.807403 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-992f40ed-5740-4475-aad8-8353978003ca admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:23.808485 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-992f40ed-5740-4475-aad8-8353978003ca admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 31 00:13:23.808885 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:24.448049 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-6a21a884-96d8-4d28-9104-f539e497e509 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:24.483411 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-6a21a884-96d8-4d28-9104-f539e497e509 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.667857 Aug 31 00:13:24.484193 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1292 bytes} [Wed Aug 31 00:13:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:13:27.490424 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-992f40ed-5740-4475-aad8-8353978003ca admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:27.491495 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-992f40ed-5740-4475-aad8-8353978003ca admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Aug 31 00:13:27.491897 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:13:27.993338 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-5678c01d-ffec-45d1-a29f-1c1003e981f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:28.013138 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-5678c01d-ffec-45d1-a29f-1c1003e981f3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.513954 Aug 31 00:13:28.013693 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:13:28.026331 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-5eb9cdfd-75eb-479e-a629-a59251e2b7fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:28.053039 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-5eb9cdfd-75eb-479e-a629-a59251e2b7fa admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030336 Aug 31 00:13:28.053853 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1333 bytes} [Wed Aug 31 00:13:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:30.417824 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-5678c01d-ffec-45d1-a29f-1c1003e981f3 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:30.418941 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-5678c01d-ffec-45d1-a29f-1c1003e981f3 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 31 00:13:30.424329 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:30 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:30.814184 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-b091a35b-22de-400a-852b-1f812dba0b5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:30.833651 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-b091a35b-22de-400a-852b-1f812dba0b5e admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408100 Aug 31 00:13:30.834217 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:30.847556 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-13657c64-1a2f-4f01-818d-05dcb36b29e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:30.872920 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-13657c64-1a2f-4f01-818d-05dcb36b29e2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029222 Aug 31 00:13:30.873498 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1333 bytes} [Wed Aug 31 00:13:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:33.302290 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-b091a35b-22de-400a-852b-1f812dba0b5e admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:33.303988 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-b091a35b-22de-400a-852b-1f812dba0b5e admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002206 Aug 31 00:13:33.305597 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:33.787495 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-40638985-4ee7-44f4-8181-ad67d9dea20c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0, "id": "3", "disk": 40, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:33.811918 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-40638985-4ee7-44f4-8181-ad67d9dea20c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.497647 Aug 31 00:13:33.812495 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:33.825188 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-77fc7210-e78b-4e2c-b2c9-342afc0f3a3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:33.853339 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-77fc7210-e78b-4e2c-b2c9-342afc0f3a3a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031785 Aug 31 00:13:33.854507 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1333 bytes} [Wed Aug 31 00:13:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:36.354407 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-40638985-4ee7-44f4-8181-ad67d9dea20c admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:36.355719 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-40638985-4ee7-44f4-8181-ad67d9dea20c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001740 Aug 31 00:13:36.356117 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:36.844258 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-729af648-4bd8-4d99-98ce-3376437043d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "id": "4", "vcpus": 4, "disk": 80, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:36.851343 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG dbcounter [-] [112108] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:36.870024 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-729af648-4bd8-4d99-98ce-3376437043d6 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.507499 Aug 31 00:13:36.871295 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:36.883934 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-e32f072d-a0db-4866-84ae-a6fd25714099 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:36.911884 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-e32f072d-a0db-4866-84ae-a6fd25714099 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032683 Aug 31 00:13:36.912601 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1333 bytes} [Wed Aug 31 00:13:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:39.336748 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-729af648-4bd8-4d99-98ce-3376437043d6 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:39.337763 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-729af648-4bd8-4d99-98ce-3376437043d6 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 31 00:13:39.338329 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:13:39.917333 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-670bdc25-ac04-4e5a-a447-b6bcde96838d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "id": "5"}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:39.923368 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:39.939843 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-670bdc25-ac04-4e5a-a447-b6bcde96838d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.595260 Aug 31 00:13:39.940777 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:39.955635 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-fbe1f133-967a-42e0-b819-abc0def0d9f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:39.983663 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-fbe1f133-967a-42e0-b819-abc0def0d9f7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033769 Aug 31 00:13:39.984862 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1333 bytes} [Wed Aug 31 00:13:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:57.654363 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-670bdc25-ac04-4e5a-a447-b6bcde96838d admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:57.655382 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-670bdc25-ac04-4e5a-a447-b6bcde96838d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 31 00:13:57.655788 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:13:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:57.667616 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG dbcounter [-] [112108] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:58.058416 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-d9a65f9f-e015-4be6-8279-0ce60c2c9d5b admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:58.076683 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-d9a65f9f-e015-4be6-8279-0ce60c2c9d5b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413621 Aug 31 00:13:58.077144 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1292 bytes} [Wed Aug 31 00:13:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:13:59.146219 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-670bdc25-ac04-4e5a-a447-b6bcde96838d admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:59.147239 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-670bdc25-ac04-4e5a-a447-b6bcde96838d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 31 00:13:59.147702 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:13:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:59.680479 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-32a21e4c-445e-42d9-93a4-5f475c515672 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:59.686031 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.wsgi [None req-32a21e4c-445e-42d9-93a4-5f475c515672 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-32a21e4c-445e-42d9-93a4-5f475c515672 admin admin] Request method failure captured: Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Accept: application/json Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Accept-Encoding: gzip, deflate Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Connection: keep-alive Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Content-Length: 0 Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Host: 10.222.0.47 Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Openstack-Api-Version: compute 2.90 Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Openstack-System-Scope: None Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: User-Agent: python-novaclient Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Auth-Token: gAAAAABjDqfHYrYlJa6Qc9FQmeCp9HHiIF5o5WDcOccr9GmbLhAGr99sM0zQNOatys9_jOxxQnb7WTFY574LoVY2rSgXX5-O2az0dDaadrZvIuwum8-FhTF855SaQ55aFpuxqrffLtbRNEJWKGWBJx4z7MXDtuVRcIyRWwoy1V6p8y5j4M8vWaM Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Domain-Id: None Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Domain-Name: None Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Identity-Status: Confirmed Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Is-Admin-Project: True Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Domain-Id: default Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Domain-Name: Default Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Name: admin Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Role: reader,admin,member Aug 31 00:13:59.689324 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Roles: reader,admin,member Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_549d5b0e486743c994271a9e51f4023c"}]}] Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Tenant: admin Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Tenant-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Tenant-Name: admin Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User: admin Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Domain-Id: default Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Domain-Name: Default Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Id: 11b70534c08c4c45883d75f7a7aeed08 Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Name: admin Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: method: > Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: exception: Flavor 42 could not be found. Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: action_args: {'id': '42'} Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:13:59.691502 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:13:59.692659 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:13:59.694121 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-32a21e4c-445e-42d9-93a4-5f475c515672 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:13:59.695402 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-32a21e4c-445e-42d9-93a4-5f475c515672 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.404194 Aug 31 00:13:59.695402 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 31 00:13:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:59.701598 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-0da809f9-a89d-4cb9-a72a-228ac8133145 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:59.725160 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-0da809f9-a89d-4cb9-a72a-228ac8133145 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027504 Aug 31 00:13:59.725718 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 31 00:13:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:13:59.735617 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-2d73f8d0-4d85-4c2d-a99f-c8d5aaef3d82 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:59.759633 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-2d73f8d0-4d85-4c2d-a99f-c8d5aaef3d82 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027550 Aug 31 00:13:59.760197 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 31 00:13:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:13:59.770768 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-a99af9eb-280c-4268-9a11-7c907a8343c4 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:59.776503 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.wsgi [None req-a99af9eb-280c-4268-9a11-7c907a8343c4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-a99af9eb-280c-4268-9a11-7c907a8343c4 admin admin] Request method failure captured: Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Accept: application/json Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Accept-Encoding: gzip, deflate Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Connection: keep-alive Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Content-Length: 0 Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Host: 10.222.0.47 Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Openstack-Api-Version: compute 2.90 Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Openstack-System-Scope: None Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: User-Agent: python-novaclient Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Auth-Token: gAAAAABjDqfHYrYlJa6Qc9FQmeCp9HHiIF5o5WDcOccr9GmbLhAGr99sM0zQNOatys9_jOxxQnb7WTFY574LoVY2rSgXX5-O2az0dDaadrZvIuwum8-FhTF855SaQ55aFpuxqrffLtbRNEJWKGWBJx4z7MXDtuVRcIyRWwoy1V6p8y5j4M8vWaM Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Domain-Id: None Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Domain-Name: None Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Identity-Status: Confirmed Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Is-Admin-Project: True Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Domain-Id: default Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Domain-Name: Default Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Name: admin Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Role: reader,admin,member Aug 31 00:13:59.779746 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Roles: reader,admin,member Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_549d5b0e486743c994271a9e51f4023c"}]}] Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Tenant: admin Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Tenant-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Tenant-Name: admin Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User: admin Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Domain-Id: default Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Domain-Name: Default Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Id: 11b70534c08c4c45883d75f7a7aeed08 Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Name: admin Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: method: > Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: exception: Flavor 42 could not be found. Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: action_args: {'id': '42'} Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:13:59.781389 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:13:59.782699 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:13:59.784052 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-a99af9eb-280c-4268-9a11-7c907a8343c4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:13:59.785351 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-a99af9eb-280c-4268-9a11-7c907a8343c4 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014849 Aug 31 00:13:59.785351 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 31 00:13:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:00.753536 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-2d73f8d0-4d85-4c2d-a99f-c8d5aaef3d82 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:00.754524 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-2d73f8d0-4d85-4c2d-a99f-c8d5aaef3d82 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Aug 31 00:14:00.754914 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:01.289289 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-bb964000-724a-4a1b-a76d-fd90798acbf2 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:01.294557 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.wsgi [None req-bb964000-724a-4a1b-a76d-fd90798acbf2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-bb964000-724a-4a1b-a76d-fd90798acbf2 admin admin] Request method failure captured: Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Accept: application/json Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Accept-Encoding: gzip, deflate Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Connection: keep-alive Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Content-Length: 0 Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Host: 10.222.0.47 Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Openstack-Api-Version: compute 2.90 Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Openstack-System-Scope: None Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: User-Agent: python-novaclient Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Auth-Token: gAAAAABjDqfIUCISswFH4cy2zn6ucwSPXiRzBCwu81cl97eOr45bUGEHMepVBs7xmx_RFgiMVJeIMhx8vJ--5Ema7ojSOTyhgZTD2UfizstWrJzKP_l3eg_Ce7eQVuEXaAEHYfP7XyVVRnyDECk2TtGAI6v7JT5ZtVZVmXasT3EjhGJ3e7_RwSE Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Domain-Id: None Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Domain-Name: None Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Identity-Status: Confirmed Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Is-Admin-Project: True Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Domain-Id: default Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Domain-Name: Default Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Name: admin Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Role: reader,admin,member Aug 31 00:14:01.296058 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Roles: reader,admin,member Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_549d5b0e486743c994271a9e51f4023c"}]}] Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Tenant: admin Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Tenant-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Tenant-Name: admin Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User: admin Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Domain-Id: default Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Domain-Name: Default Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Id: 11b70534c08c4c45883d75f7a7aeed08 Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Name: admin Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: method: > Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: exception: Flavor 84 could not be found. Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: action_args: {'id': '84'} Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:14:01.297638 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:01.298615 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:14:01.300184 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-bb964000-724a-4a1b-a76d-fd90798acbf2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:14:01.301430 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-bb964000-724a-4a1b-a76d-fd90798acbf2 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.404338 Aug 31 00:14:01.301430 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 31 00:14:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:01.307198 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-f72649bb-5adc-421b-963a-6789bf2d2ea3 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:01.322846 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-f72649bb-5adc-421b-963a-6789bf2d2ea3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019252 Aug 31 00:14:01.323387 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 31 00:14:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:14:01.333614 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-2671fbd0-ec7a-4cc6-898e-16e7f99e3b19 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:01.349003 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-2671fbd0-ec7a-4cc6-898e-16e7f99e3b19 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019634 Aug 31 00:14:01.349546 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 31 00:14:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:14:01.358985 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-e4964b71-82aa-41a7-9e54-430751ab16cf admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:01.364665 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.wsgi [None req-e4964b71-82aa-41a7-9e54-430751ab16cf admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-e4964b71-82aa-41a7-9e54-430751ab16cf admin admin] Request method failure captured: Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Accept: application/json Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Accept-Encoding: gzip, deflate Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Connection: keep-alive Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Content-Length: 0 Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Host: 10.222.0.47 Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Openstack-Api-Version: compute 2.90 Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Openstack-System-Scope: None Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: User-Agent: python-novaclient Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Auth-Token: gAAAAABjDqfIUCISswFH4cy2zn6ucwSPXiRzBCwu81cl97eOr45bUGEHMepVBs7xmx_RFgiMVJeIMhx8vJ--5Ema7ojSOTyhgZTD2UfizstWrJzKP_l3eg_Ce7eQVuEXaAEHYfP7XyVVRnyDECk2TtGAI6v7JT5ZtVZVmXasT3EjhGJ3e7_RwSE Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Domain-Id: None Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Domain-Name: None Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Identity-Status: Confirmed Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Is-Admin-Project: True Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Domain-Id: default Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Domain-Name: Default Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Name: admin Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Role: reader,admin,member Aug 31 00:14:01.366194 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Roles: reader,admin,member Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_549d5b0e486743c994271a9e51f4023c"}]}] Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Tenant: admin Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Tenant-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Tenant-Name: admin Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User: admin Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Domain-Id: default Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Domain-Name: Default Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Id: 11b70534c08c4c45883d75f7a7aeed08 Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Name: admin Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: method: > Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: exception: Flavor 84 could not be found. Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: action_args: {'id': '84'} Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:14:01.367732 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:01.368731 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:14:01.370229 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-e4964b71-82aa-41a7-9e54-430751ab16cf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:14:01.371546 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-e4964b71-82aa-41a7-9e54-430751ab16cf admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012200 Aug 31 00:14:01.371546 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 31 00:14:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:02.354272 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-2671fbd0-ec7a-4cc6-898e-16e7f99e3b19 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:02.355283 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-2671fbd0-ec7a-4cc6-898e-16e7f99e3b19 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 31 00:14:02.355673 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:02.894598 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-6b7c6f04-f015-4b51-b968-1b6151118474 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:02.900321 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.wsgi [None req-6b7c6f04-f015-4b51-b968-1b6151118474 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-6b7c6f04-f015-4b51-b968-1b6151118474 admin admin] Request method failure captured: Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Accept: application/json Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Accept-Encoding: gzip, deflate Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Connection: keep-alive Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Content-Length: 0 Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Host: 10.222.0.47 Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Openstack-Api-Version: compute 2.90 Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Openstack-System-Scope: None Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: User-Agent: python-novaclient Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Auth-Token: gAAAAABjDqfKrEhVaEakbVPhOSfgm9hf2skkqzMnQlnBEVOVTFc4bgHnpXLZvbYpii8ZIEiZYPXm7p5bzlLVW-xBSWrDq8f2An_WfwwuuM2BrpLSgQCT9aYOmfTb1Wi1eSWLfLeqJx6rEWnesdy9WdpLUvVp2mEu0gs_1qtjP4x7IoRMW-tNgSo Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Domain-Id: None Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Domain-Name: None Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Identity-Status: Confirmed Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Is-Admin-Project: True Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Domain-Id: default Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Domain-Name: Default Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Project-Name: admin Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Role: reader,admin,member Aug 31 00:14:02.901811 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Roles: reader,admin,member Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_549d5b0e486743c994271a9e51f4023c"}]}] Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Tenant: admin Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Tenant-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-Tenant-Name: admin Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User: admin Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Domain-Id: default Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Domain-Name: Default Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Id: 11b70534c08c4c45883d75f7a7aeed08 Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: X-User-Name: admin Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: method: > Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: exception: Flavor 451 could not be found. Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: action_args: {'id': '451'} Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:14:02.903428 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:02.904601 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: ERROR nova.api.openstack.wsgi Aug 31 00:14:02.905970 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-6b7c6f04-f015-4b51-b968-1b6151118474 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:14:02.907511 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-6b7c6f04-f015-4b51-b968-1b6151118474 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.409438 Aug 31 00:14:02.907511 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 31 00:14:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:02.913721 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-b86dac52-8015-4084-8700-6b433c39903f admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:02.929006 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-b86dac52-8015-4084-8700-6b433c39903f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018900 Aug 31 00:14:02.929559 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 31 00:14:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:14:02.939169 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:02.955131 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019534 Aug 31 00:14:02.956277 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 31 00:14:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:14:02.965852 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-8d1c0584-e163-473f-99d5-5fceda7000c2 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:02.971220 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.wsgi [None req-8d1c0584-e163-473f-99d5-5fceda7000c2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-8d1c0584-e163-473f-99d5-5fceda7000c2 admin admin] Request method failure captured: Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Accept: application/json Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Accept-Encoding: gzip, deflate Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Connection: keep-alive Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Content-Length: 0 Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Host: 10.222.0.47 Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Openstack-Api-Version: compute 2.90 Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Openstack-System-Scope: None Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: User-Agent: python-novaclient Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Auth-Token: gAAAAABjDqfKrEhVaEakbVPhOSfgm9hf2skkqzMnQlnBEVOVTFc4bgHnpXLZvbYpii8ZIEiZYPXm7p5bzlLVW-xBSWrDq8f2An_WfwwuuM2BrpLSgQCT9aYOmfTb1Wi1eSWLfLeqJx6rEWnesdy9WdpLUvVp2mEu0gs_1qtjP4x7IoRMW-tNgSo Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Domain-Id: None Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Domain-Name: None Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Identity-Status: Confirmed Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Is-Admin-Project: True Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Domain-Id: default Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Domain-Name: Default Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Project-Name: admin Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Role: reader,admin,member Aug 31 00:14:02.972779 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Roles: reader,admin,member Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/549d5b0e486743c994271a9e51f4023c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_549d5b0e486743c994271a9e51f4023c"}]}] Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Tenant: admin Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Tenant-Id: 549d5b0e486743c994271a9e51f4023c Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-Tenant-Name: admin Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User: admin Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Domain-Id: default Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Domain-Name: Default Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Id: 11b70534c08c4c45883d75f7a7aeed08 Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: X-User-Name: admin Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: method: > Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: exception: Flavor 451 could not be found. Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: action_args: {'id': '451'} Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:14:02.974410 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:02.975577 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: ERROR nova.api.openstack.wsgi Aug 31 00:14:02.977130 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-8d1c0584-e163-473f-99d5-5fceda7000c2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:14:02.978412 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-8d1c0584-e163-473f-99d5-5fceda7000c2 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011816 Aug 31 00:14:02.978412 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 31 00:14:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:03.965643 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:03.966687 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 31 00:14:03.967234 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:04.500589 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-fbb651b0-5599-44eb-8063-55aed41b7a5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:14:04.520373 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-fbb651b0-5599-44eb-8063-55aed41b7a5b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.415426 Aug 31 00:14:04.520920 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 31 00:14:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:14:05.514024 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:05.515061 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 31 00:14:05.515456 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:06.050599 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-90b6dabd-6c02-4b16-919f-91da755115e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:14:06.070819 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-90b6dabd-6c02-4b16-919f-91da755115e3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.414271 Aug 31 00:14:06.071378 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 31 00:14:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:14:07.055885 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:07.056965 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 31 00:14:07.057396 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:07.592652 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-b9559791-df09-4be1-9f1a-0b8875f4cad7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:14:07.612650 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-b9559791-df09-4be1-9f1a-0b8875f4cad7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.415239 Aug 31 00:14:07.613193 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 31 00:14:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:14:08.582220 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:08.583218 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 31 00:14:08.583598 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:09.111042 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-2400d9f4-84c8-4165-bf64-4aad82734ecc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:14:09.131457 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-2400d9f4-84c8-4165-bf64-4aad82734ecc admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.411731 Aug 31 00:14:09.132006 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 31 00:14:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:14:10.118352 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:10.119369 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 31 00:14:10.119767 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:10.654889 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-e97d9ff0-d46f-4988-8663-6ad39a4e72fc admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:10.676268 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-e97d9ff0-d46f-4988-8663-6ad39a4e72fc admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.415611 Aug 31 00:14:10.676730 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Wed Aug 31 00:14:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:15:04.848602 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:04.849488 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-dce2967f-e598-4ec1-89e4-91a6fb941670 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 31 00:15:04.849885 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 31 00:15:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:15:04.860998 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:05.272679 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-3433b1bb-23b4-4d88-8cc0-594833389226 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:05.293835 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-3433b1bb-23b4-4d88-8cc0-594833389226 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.437998 Aug 31 00:15:05.294369 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1292 bytes} [Wed Aug 31 00:15:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:15:05.316793 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG dbcounter [-] [112108] Writing DB stats nova_api:SELECT=14 {{(pid=112108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:05.320665 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-f7401bfa-e272-44a0-aecd-f7a16c5d6ad4 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:05.330468 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-f7401bfa-e272-44a0-aecd-f7a16c5d6ad4 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015053 Aug 31 00:15:05.331018 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1283 bytes} [Wed Aug 31 00:15:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:05.342748 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-b3e8ea57-adb7-4650-a9f7-6fc38aeee800 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:05.350735 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-b3e8ea57-adb7-4650-a9f7-6fc38aeee800 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011495 Aug 31 00:15:05.351256 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1286 bytes} [Wed Aug 31 00:15:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:05.363803 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-bd30ee97-51f0-4b2f-a26f-2eccb4be74b7 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:05.371483 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-bd30ee97-51f0-4b2f-a26f-2eccb4be74b7 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012394 Aug 31 00:15:05.372004 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1286 bytes} [Wed Aug 31 00:15:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:05.384218 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-821c4d84-bd37-4930-a0ec-728bc99de279 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:05.392318 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-821c4d84-bd37-4930-a0ec-728bc99de279 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011678 Aug 31 00:15:05.392835 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1283 bytes} [Wed Aug 31 00:15:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:18:04.795304 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-bd30ee97-51f0-4b2f-a26f-2eccb4be74b7 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:04.796737 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-bd30ee97-51f0-4b2f-a26f-2eccb4be74b7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001866 Aug 31 00:18:04.797284 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:18:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:18:04.953085 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writing DB stats nova_api:SELECT=6 {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:05.151883 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-16c3f3d0-b188-4745-be6b-08f474f35861 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:05.156387 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-16c3f3d0-b188-4745-be6b-08f474f35861 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:05.157007 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-16c3f3d0-b188-4745-be6b-08f474f35861 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:05.157571 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-16c3f3d0-b188-4745-be6b-08f474f35861 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:05.158363 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-16c3f3d0-b188-4745-be6b-08f474f35861 admin admin] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:05.158858 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-16c3f3d0-b188-4745-be6b-08f474f35861 admin admin] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:05.159316 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-16c3f3d0-b188-4745-be6b-08f474f35861 admin admin] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:05.200821 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-16c3f3d0-b188-4745-be6b-08f474f35861 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.249199 Aug 31 00:18:05.201515 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 31 00:18:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:18:06.112481 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-bd30ee97-51f0-4b2f-a26f-2eccb4be74b7 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:06.113542 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-bd30ee97-51f0-4b2f-a26f-2eccb4be74b7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Aug 31 00:18:06.113950 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:18:06.323079 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-ffdc0e1c-d5ef-4893-b529-e34d4b114165 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:06.329777 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-ffdc0e1c-d5ef-4893-b529-e34d4b114165 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:06.330661 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-ffdc0e1c-d5ef-4893-b529-e34d4b114165 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:06.331451 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-ffdc0e1c-d5ef-4893-b529-e34d4b114165 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:06.332815 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-ffdc0e1c-d5ef-4893-b529-e34d4b114165 admin admin] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:06.333637 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-ffdc0e1c-d5ef-4893-b529-e34d4b114165 admin admin] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:06.334411 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-ffdc0e1c-d5ef-4893-b529-e34d4b114165 admin admin] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:06.380892 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-ffdc0e1c-d5ef-4893-b529-e34d4b114165 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.120186 Aug 31 00:18:06.381968 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 31 00:18:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:18:17.755717 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-bd30ee97-51f0-4b2f-a26f-2eccb4be74b7 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:17.758725 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-bd30ee97-51f0-4b2f-a26f-2eccb4be74b7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003703 Aug 31 00:18:17.759646 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:18:17.914137 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writing DB stats nova_cell0:SELECT=4 {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:17.915143 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writing DB stats nova_cell1:SELECT=4 {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:17.916614 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG dbcounter [-] [112109] Writing DB stats nova_api:SELECT=8 {{(pid=112109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:17.977019 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-565c1bc8-c092-4bd8-8cdb-ca000fb02706 admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:17.983865 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-565c1bc8-c092-4bd8-8cdb-ca000fb02706 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:17.984797 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-565c1bc8-c092-4bd8-8cdb-ca000fb02706 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:17.985503 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-565c1bc8-c092-4bd8-8cdb-ca000fb02706 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:17.986836 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-565c1bc8-c092-4bd8-8cdb-ca000fb02706 admin admin] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:17.987632 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-565c1bc8-c092-4bd8-8cdb-ca000fb02706 admin admin] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:17.988405 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-565c1bc8-c092-4bd8-8cdb-ca000fb02706 admin admin] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:18.042905 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-565c1bc8-c092-4bd8-8cdb-ca000fb02706 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.133236 Aug 31 00:18:18.044181 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 31 00:18:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:18:18.973498 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: DEBUG nova.api.openstack.wsgi [None req-bd30ee97-51f0-4b2f-a26f-2eccb4be74b7 admin admin] Calling method '>' {{(pid=112108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:18.974523 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: INFO nova.api.openstack.requestlog [None req-bd30ee97-51f0-4b2f-a26f-2eccb4be74b7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 31 00:18:18.974928 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: [pid: 112108|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 31 00:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:18:19.184104 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG nova.api.openstack.wsgi [None req-133b6a75-b15f-42bd-83ba-0a9a64d268bf admin admin] Calling method '>' {{(pid=112109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:19.187968 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-133b6a75-b15f-42bd-83ba-0a9a64d268bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:19.188528 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-133b6a75-b15f-42bd-83ba-0a9a64d268bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:19.188956 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-133b6a75-b15f-42bd-83ba-0a9a64d268bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:19.189674 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-133b6a75-b15f-42bd-83ba-0a9a64d268bf admin admin] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:19.190117 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-133b6a75-b15f-42bd-83ba-0a9a64d268bf admin admin] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:19.190525 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: DEBUG oslo_concurrency.lockutils [None req-133b6a75-b15f-42bd-83ba-0a9a64d268bf admin admin] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:19.215009 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: INFO nova.api.openstack.requestlog [None req-133b6a75-b15f-42bd-83ba-0a9a64d268bf admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089701 Aug 31 00:18:19.215608 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: [pid: 112109|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 31 00:18:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:19.895297 dv-cinder-852210-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 00:19:19.896668 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: Wed Aug 31 00:19:19 2022 - graceful shutdown triggered... Aug 31 00:19:19.897349 dv-cinder-852210-5-iscsi devstack@n-api.service[112108]: Gracefully killing worker 1 (pid: 112108)... Aug 31 00:19:19.898188 dv-cinder-852210-5-iscsi devstack@n-api.service[112109]: Gracefully killing worker 2 (pid: 112109)... Aug 31 00:19:20.896312 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: worker 1 buried after 1 seconds Aug 31 00:19:20.896660 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: worker 2 buried after 1 seconds Aug 31 00:19:20.896660 dv-cinder-852210-5-iscsi devstack@n-api.service[112107]: goodbye to uWSGI. Aug 31 00:19:20.898457 dv-cinder-852210-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 00:19:20.899041 dv-cinder-852210-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 00:19:20.902544 dv-cinder-852210-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 00:19:20.915802 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 00:19:20.919755 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:19:20 2022] *** Aug 31 00:19:20.920048 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:19:20.920306 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:19:20.920492 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: nodename: dv-cinder-852210-5-iscsi Aug 31 00:19:20.920660 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: machine: x86_64 Aug 31 00:19:20.920839 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: clock source: unix Aug 31 00:19:20.921008 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: pcre jit disabled Aug 31 00:19:20.922101 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: detected number of CPU cores: 4 Aug 31 00:19:20.922101 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: current working directory: / Aug 31 00:19:20.922101 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:19:20.922101 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: your processes number limit is 47680 Aug 31 00:19:20.922101 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: your memory page size is 4096 bytes Aug 31 00:19:20.922101 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: detected max file descriptor number: 2048 Aug 31 00:19:20.922942 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: lock engine: pthread robust mutexes Aug 31 00:19:20.922942 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: thunder lock: enabled Aug 31 00:19:20.922942 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 00:19:20.922942 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:19:20.965719 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: Python main interpreter initialized at 0x556d62f4c9c0 Aug 31 00:19:20.965719 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: python threads support enabled Aug 31 00:19:20.965719 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: your server socket listen backlog is limited to 100 connections Aug 31 00:19:20.965719 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:19:20.966171 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:19:20.966171 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: *** Operational MODE: preforking *** Aug 31 00:19:20.966478 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:19:20.966478 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: spawned uWSGI master process (pid: 127102) Aug 31 00:19:20.966680 dv-cinder-852210-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 00:19:20.969397 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: spawned uWSGI worker 1 (pid: 127117, cores: 1) Aug 31 00:19:20.969747 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: spawned uWSGI worker 2 (pid: 127118, cores: 1) Aug 31 00:19:20.969928 dv-cinder-852210-5-iscsi devstack@n-api.service[127102]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:19:21.682598 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:19:21.833795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:19:22.936947 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:19:22.936947 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: from cryptography.utils import int_from_bytes Aug 31 00:19:22.937691 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:19:22.937691 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: from cryptography.utils import int_from_bytes Aug 31 00:19:23.015973 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:19:23.015973 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: from cryptography.utils import int_from_bytes Aug 31 00:19:23.016954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:19:23.016954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: from cryptography.utils import int_from_bytes Aug 31 00:19:25.550984 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:19:25.551857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:19:25.552021 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:19:25.552389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:19:25.552655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:19:25.553044 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.553373 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.553697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.554089 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.554581 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.554904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.555261 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.555655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.556022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.556319 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.556643 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.556971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-5-iscsi {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.557299 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.557607 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.557923 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.558244 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.558551 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.558876 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.559184 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.559688 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.561763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.561763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.561763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.561763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.561763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.561763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.562707 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.562707 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.562707 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.563320 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.563320 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-5-iscsi {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.563759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.563983 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.564352 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.564709 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.565007 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.565389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.565752 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.566083 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.566393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.566815 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.567131 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.567507 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.567881 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.568243 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.568561 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.568875 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.569281 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.569612 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.569926 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.570750 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.571071 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.571472 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.571896 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.572229 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.572500 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.572878 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.573382 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.573624 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.573858 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.574142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.574480 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.574856 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.575094 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.575466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.575733 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.576047 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.576401 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.576718 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.577051 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.577387 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.577818 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.578262 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.578514 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.578818 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.579163 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.579486 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.579796 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.580118 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.580466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.580777 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.581085 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.581392 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.581714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.582058 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.582360 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.582611 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.582914 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.583216 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.583536 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.583841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.584233 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.584478 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.584780 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.585083 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.585524 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.585838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.587304 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.587304 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.587304 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.587778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.587778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.588090 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.588409 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.588737 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.589048 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.589354 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.589658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.589965 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.590303 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.590578 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.590885 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.591208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.591513 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.591819 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.592134 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.592474 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.592781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.593105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.593407 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.593715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.594036 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.594339 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.594645 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.594949 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.595257 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.595567 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.595873 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.596265 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.596510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.596814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.597140 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.597472 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.597783 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.598085 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.598391 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.598715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.599052 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.599384 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.599729 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.600045 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.600403 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.600740 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.601057 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.601905 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.602233 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.602612 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.603045 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.603376 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.603690 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.604054 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.604360 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.604695 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.605013 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.605329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.605646 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.605955 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.606465 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.606641 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.606918 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.607415 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.607772 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.608275 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.608595 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.608925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.609258 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.609600 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.609911 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.610251 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.610580 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.610917 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.611233 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.611558 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.611871 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.612222 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.612541 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.612855 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.613166 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.613478 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.613786 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.614162 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.614486 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.614814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.615157 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.615467 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.615789 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.616098 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.616439 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.616751 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.617676 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.618364 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.618817 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.619136 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.619474 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.619802 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.620194 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.620498 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.620841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.621149 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.621489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.621802 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.622136 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.622445 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.622765 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.623103 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.623412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.623764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.624061 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.624401 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.624731 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.625038 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.625344 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.625665 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.625975 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.626286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.626596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.626907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.627237 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.627549 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.627860 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.628228 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.628562 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.628869 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.629193 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.629518 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.629835 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.630139 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.630451 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.630753 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.631062 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.631366 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.631672 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.631976 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.632305 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.632643 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.632952 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.633370 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.633780 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.634003 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.634326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.634766 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.634988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.635250 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.635560 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.635909 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.636274 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.636596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.636925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.637239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.637557 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.637873 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.638186 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.638495 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.638810 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.639133 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.639445 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.639767 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.640057 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.640427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.640738 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.641059 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.641364 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.641679 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.642024 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.642362 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.642668 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.642995 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.643335 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.643629 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.643942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.644279 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.644590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.644902 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.645219 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.645529 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.645846 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.646157 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.646484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.646794 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.647113 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.647416 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.647735 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.648068 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.648455 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.648767 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.649077 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.649487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.649804 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.650115 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.650426 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.650732 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.651304 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.651611 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.651928 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.652269 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.652561 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.652866 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.653179 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.653487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.653791 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.654094 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.654553 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.654931 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.655253 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.655585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.655914 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.656253 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.656564 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.656930 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.657210 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.657537 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.657834 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.658143 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.658497 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.658808 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.659115 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.659437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.659760 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.660293 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.660474 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.660724 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.661036 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.661515 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.661863 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.662319 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.662637 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.663072 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.663393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.663707 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.664770 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.665203 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.665524 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.665838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.666226 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.666510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.666850 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.667449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.667791 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.668108 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.668481 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.668804 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.669180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.669517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.669846 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.670159 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.670466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.670776 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.671083 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.671389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.671698 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.672002 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.672336 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.672642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.673049 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.673253 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.673559 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.673864 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.674205 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.674521 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.674827 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.675171 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.675505 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.675842 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.676196 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.676482 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.676788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.677092 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.677445 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.677749 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.678096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.678428 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.678772 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.679079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.679387 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.680336 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.680648 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.680989 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.681298 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.681613 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.681923 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.682227 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.682541 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.682853 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.683167 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.683480 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.683821 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.684134 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.684490 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.684812 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.685121 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.685430 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.685781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.686038 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.686348 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.686651 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.686964 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.687275 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.687595 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.687900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.688228 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.688535 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.688848 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.689158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.689464 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.689803 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.690116 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.690422 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.690726 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.691037 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.691342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.691646 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.691956 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.692311 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.692632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.692939 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.693426 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.693590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.693836 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.694140 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.694448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.694752 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.695057 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.695412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.695717 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.696218 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.696424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.696687 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.697033 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.697414 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.697678 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.698061 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.698373 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.698762 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.699074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.699389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.699763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.700025 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.700381 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.700729 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.701034 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.701379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.701692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.702006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.702347 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.702680 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.703074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.703353 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.703661 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.703985 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.704362 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.704695 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.704999 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.705313 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.705623 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.705907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.706229 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.706546 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.706859 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.707174 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.707488 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.707801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.708114 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.708451 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.708765 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.709078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.709386 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.709725 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.710035 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.710342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.710652 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.711014 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.711326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.711632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.712083 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.712425 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.712742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.713048 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.713361 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.713672 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.713995 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.714317 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.714625 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.715060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.715378 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.715689 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.716003 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.716342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.716652 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.716966 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.717299 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.717607 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.717916 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.718220 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.718548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.718854 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.719180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.719616 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.719934 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.720263 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.720686 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.721003 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.721609 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.721609 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.721960 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.722253 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.722561 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.722880 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.723193 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.723520 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.723848 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.724183 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.724508 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.724811 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.725142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.725474 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.725797 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.726125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.727218 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.727459 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.727795 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.728258 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.728593 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.728903 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.729209 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.729524 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.729828 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.730205 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.730534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.730847 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.731162 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.731477 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.731790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.732096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.732434 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.732768 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.733076 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.733404 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.733725 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.734052 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.734376 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.734684 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.735010 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.735323 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.735633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.735942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.736274 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.736627 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.736938 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.737260 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.737596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.737927 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.738239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.738575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.738901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.739221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.739539 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.739866 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.740203 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.740498 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.740809 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.741117 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.741425 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.741731 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.742676 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.743187 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.743525 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.743835 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.744192 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.744512 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.744841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.745165 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.745475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.745785 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.746093 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.746449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.746759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.747094 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.747409 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.747741 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.748060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.748408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.748728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.749116 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.749554 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.749892 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.750314 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.750686 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.751017 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.751412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.751642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.752245 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.752577 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.752896 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.753211 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.753526 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.753841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.754157 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.754468 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.754781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.755101 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.755409 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.756620 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.756620 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.756620 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.757271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.757271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.758200 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.758200 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.758675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.759102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.759423 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.759736 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.760146 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.760513 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.760832 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.761150 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.761466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.761814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.762098 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.762412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.762727 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.763039 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.763375 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.763939 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.764461 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.764831 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.765329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.765837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.766286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.766929 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.767278 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.767727 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.768062 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.768462 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.768920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.769361 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.769751 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.770070 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.770383 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.770701 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.771020 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.771328 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.771662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.771981 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.772321 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.772662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.773060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.774296 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.774667 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.775163 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.775635 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.776418 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.776817 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.777134 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.777472 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.777789 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.778358 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.778573 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.778786 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.778998 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.779348 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.779843 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.780243 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.780555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.780925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.781285 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.781797 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.782142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.782360 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.784884 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.786110 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.786849 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.787498 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.788232 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.789232 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.790511 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.791045 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.791594 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.792724 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.793387 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.793829 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.794244 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.794688 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.795170 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.795664 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.796116 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.796670 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.797317 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.797791 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.798341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.798679 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.799064 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.799426 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.800091 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.800521 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.800861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.801214 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.801629 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.801990 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.802411 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.803042 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.803448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.803899 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.804278 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.804710 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.805092 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.805421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.805744 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.806072 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.806432 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.806758 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.807064 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.807387 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.807810 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.808323 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.808828 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.809291 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.809752 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.810181 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.810585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.810920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.811254 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.811582 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.811908 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.812544 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.812875 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.813203 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.813555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.813881 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.814204 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.814649 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.814971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.815298 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.815627 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.815943 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.818963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.818963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.818963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.818963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.818963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.818963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.818963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.818963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.820678 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.820678 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.820678 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.820678 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.820678 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.821352 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.821352 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.821702 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.822248 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.822866 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.823379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.823963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.824549 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.825045 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.825628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.825888 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.826144 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.826418 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.826736 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.827048 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.827363 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.827701 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.827956 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.828311 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.828620 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.829857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.829857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.829857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.829857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.830827 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.830827 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.830827 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.831507 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.831507 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.831971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.832314 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.833664 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.833664 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.833664 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.835487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.835487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.835487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.835487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.835487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.835487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.837477 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.837477 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.837477 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.837477 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.838069 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.838069 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.838509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.838911 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.839445 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.839924 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.840373 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.840804 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.841162 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.841480 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.841807 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.842127 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.842448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.842828 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.843154 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.843501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.843840 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.844197 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.844520 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.844858 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.845216 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.845534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.845887 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.846223 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.846677 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.846868 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.847157 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:25.847402 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:19:25.928051 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO dbcounter [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Registered counter for database nova_api Aug 31 00:19:25.957535 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_db.sqlalchemy.engines [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:25.968278 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writer thread running {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:25.969434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:19:25.970176 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:19:25.970770 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:19:25.971423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:19:25.971855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:19:25.972579 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.973269 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.973817 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.974385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.975096 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.975589 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.976217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.976833 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.977429 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.978175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.978739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.979350 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-5-iscsi {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.979939 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.980553 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.986277 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.986277 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.986277 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.986277 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.986277 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.986277 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.987206 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.987206 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.987206 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.987206 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.987206 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.987912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.988114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.988922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.989743 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.990544 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.991520 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-5-iscsi {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.993538 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.994644 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.995239 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.996025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.996907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.997729 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.998535 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:25.999391 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.000270 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.001176 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.002114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.003036 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.003880 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.004663 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.005465 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.006252 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.007077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.008708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.009570 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.010045 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.010600 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.011210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.011793 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.012444 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.012920 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.013377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.013967 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.014808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.015366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.015938 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.016597 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.017120 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.017699 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.018327 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.018858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.019434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.020040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.020843 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.021531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.022195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.022782 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.023785 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.024398 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.025017 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.025652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.026566 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.027185 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.027753 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.028411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.028990 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.029576 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.030154 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.030762 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.031363 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.032193 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.032900 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.033473 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.034043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.034659 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.035225 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.035798 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.036371 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.036943 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.037509 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.038068 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.038640 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.039237 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.039806 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.040434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.041008 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.041591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.042148 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.042762 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.043342 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.043902 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.044496 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.045056 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.045613 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.046203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.046735 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.046919 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.context [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5fd1dd09-69f2-4bc1-8110-3d087c5f7a55(cell1) {{(pid=127117) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:19:26.047201 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.048033 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.048619 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.049199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.049797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.050336 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.050910 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.051509 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.051690 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.052039 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.052345 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.052613 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.053392 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.053937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:26.054150 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.055563 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.055751 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.056137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.056796 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.057591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.058394 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.058584 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:26.059379 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.060138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.060678 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.061172 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.061334 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO dbcounter [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Registered counter for database nova_cell0 Aug 31 00:19:26.061684 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.062247 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.062817 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.063377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.063929 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.064675 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:26.065517 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.066122 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.066738 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.067305 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.067906 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.068093 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO dbcounter [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Registered counter for database nova_cell1 Aug 31 00:19:26.068539 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.069116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.069687 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.070810 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.071617 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.077487 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.078526 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.079354 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.080393 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.081275 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.081893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.082146 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_db.sqlalchemy.engines [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:26.082473 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.083046 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.083615 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.084212 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.084792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.085385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.086002 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.086745 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_db.sqlalchemy.engines [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:26.086931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.087385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.088265 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.089041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.089625 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.090199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.090746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.091200 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writer thread running {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:26.091729 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.092546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.093366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.093945 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.094479 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.095301 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.095818 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.096399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.096910 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.097413 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.097909 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.098409 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.098911 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.099479 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.100309 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.101217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.101781 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.102849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.103456 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.103987 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.104653 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.105354 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.105985 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.106533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.107063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.107775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.108646 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.109218 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.109718 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.110172 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.110684 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.111163 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.111642 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.112142 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.112634 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.113299 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.113791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.114292 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.114825 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.115405 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.115954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.116563 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.117685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.118247 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.118802 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.119369 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.119937 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.120531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.121077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.121571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.122136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.122483 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.122832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.123417 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.123609 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.124972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.124972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.124972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.124972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.125971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.125971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.125971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.126671 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.126924 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.127168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.127865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.128132 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.128543 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.129006 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.129501 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.129985 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.130430 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.130899 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.131374 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.131838 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.132376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.133607 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.133891 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.134152 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.134585 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.134848 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.135080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.135511 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.135778 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.136026 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.136403 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.136725 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.137188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.137870 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.138125 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.138543 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.139110 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.139511 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.140027 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.140498 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.140948 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.141480 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.141979 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.142487 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.142930 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.143291 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.143602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.144379 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.144379 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.145059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.145059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.145513 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.145513 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.145957 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.146183 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.146460 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.146778 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.147241 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.147670 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.148318 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.149771 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.149771 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.149771 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.150479 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.150710 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.151233 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.152017 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.152362 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.152654 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.153142 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.153470 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.153784 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.154107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.154656 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.154909 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.155372 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.155372 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.155827 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.156039 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.156311 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.156633 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.156954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.157291 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.157624 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.157943 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.158520 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.158791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.159006 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.159257 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.159533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.160117 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.160428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.160706 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.160971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.161224 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.161502 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.161840 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.162339 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.162602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.162827 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.163256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.163494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.164256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.164256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.165136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.165136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.165136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.166248 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.166248 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.166248 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.166920 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.166920 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.166920 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.167591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.167881 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.168616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.168616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.169082 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.169315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.169653 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.170107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.170520 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.170757 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.171042 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.171386 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.171619 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.171846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.172201 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.172602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.172849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.173076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.173494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.173740 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.174059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.174304 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.174552 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.175005 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.175385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.175618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.176062 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.176395 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.176654 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.176876 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.177116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.177346 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.177688 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.178000 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.178352 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.178918 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.179152 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.180319 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.180804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.181078 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.181328 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.181541 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.181775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.182057 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.182380 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.182805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.183043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.183714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.183714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.184314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.184314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.184800 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.185199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.185199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.185828 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.185828 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.186504 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.186504 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.187194 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.187194 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.187651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.187651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.188099 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.188361 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.189091 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.189091 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.189566 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.189566 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.190213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.190213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.191065 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.191065 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.191065 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.191722 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.191722 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.192238 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.192498 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.192903 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.193125 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.193380 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.193639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.194055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.194363 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.194603 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.194859 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.195983 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.195983 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.196733 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.196733 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.197232 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.197232 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.197726 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.197975 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.198222 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.198465 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.198782 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.199307 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.199553 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.199768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.200061 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.200422 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.200821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.201882 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.202490 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.203053 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.203643 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.204343 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.205022 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.205601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.206190 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.206786 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.207348 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.207929 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.208563 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.209396 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.209785 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.210420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.211068 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.211574 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.212071 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.212572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.213139 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.213666 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.214243 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.214831 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.215377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.215909 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.216477 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.216999 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.217534 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.218063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.218612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.219146 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.219671 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.220228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.220755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.221298 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.221806 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.222572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.223125 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.223692 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.224384 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.224893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.225460 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.226029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.226629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.227199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.228041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.228683 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.229286 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.229845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.230449 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.230999 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.231633 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.232304 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.232870 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.233479 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.233941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.234541 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.235267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.235720 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.236651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.237185 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.237841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.238630 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.239198 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.239875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.240468 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.241022 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.241603 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.242716 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.243292 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.243850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.244504 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.245655 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.246181 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.246828 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.247312 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.248042 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.248512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.249102 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.249787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.250569 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.251180 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.251777 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.252478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.254375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.255348 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.255866 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.256491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.257106 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.257713 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.259797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.260002 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writer thread running {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:26.260571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.260571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.260571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.261248 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.261590 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.262106 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.262685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.263199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.263803 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.264376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.265012 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.265607 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.266169 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.267453 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.267453 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.267922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.268513 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.269065 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.269697 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.270259 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.270841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.271345 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO dbcounter [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Registered counter for database nova_cell0 Aug 31 00:19:26.271463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.271981 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.272545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.273202 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.274541 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.274916 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.275484 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.276366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.276969 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.277558 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.278191 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.278737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.279296 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.279515 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_db.sqlalchemy.engines [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:26.279858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.280501 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.281086 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.281662 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.282236 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.282835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.283399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.283984 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.284534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writer thread running {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:26.284664 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.285308 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.285865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.286406 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.287025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.287572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.288262 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.288773 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.289908 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.290482 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.291027 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.291642 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.292326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.292946 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.293597 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.294248 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.294867 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.295435 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.296078 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.296710 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.297692 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.297692 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.297692 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.297692 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.297692 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.301087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.301245 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.301692 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.302277 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.302877 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.303455 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.304412 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.305081 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.305706 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.306299 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.306848 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.307437 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.307956 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.308532 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.309262 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.309690 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.310226 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.310750 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.311294 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.311824 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.312382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.312926 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.313468 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.313997 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.314529 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.315053 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.315577 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.316111 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.316728 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.317361 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.317954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.318552 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.319129 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.319716 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.321339 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.322000 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.322646 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.323308 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.323928 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.324534 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.325091 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.325668 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.326249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.326820 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.327383 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.327959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.328564 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.329179 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.329787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.330387 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.330962 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.331534 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.332722 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.333456 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.334183 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.334933 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.335585 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.337034 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.337580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.338218 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.338814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.339376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.339958 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.341013 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.341449 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.342013 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.342601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.343180 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.343907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.344536 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.345119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.345737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.346319 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.346911 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.347505 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.348109 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.348739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.349327 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.349916 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.350502 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.351107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.352533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.353109 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.353671 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.354238 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.354795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.355370 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.356022 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.356688 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.357280 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.357941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.358560 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.359163 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.359785 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.360420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.361021 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.361704 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.362313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.363462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.364107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.364863 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.365512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.366415 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.367803 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.368427 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.369028 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.369655 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.370257 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.370864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.371430 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.372021 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.372658 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.373209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.373780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.374355 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.374935 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.375477 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.376036 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.376646 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.377234 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.377839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.378448 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.379111 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.379749 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.380425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.381033 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.381629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.382212 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.383367 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.383972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.384864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.385529 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.386377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.386818 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.387311 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.388119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.388673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.389191 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.389676 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.390147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.390630 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.391156 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.391634 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.392115 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.392611 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.393130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.393646 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.394145 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.394706 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.395211 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.395682 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.396172 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.396800 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.397253 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.397712 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.398190 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.399293 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.399835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.400351 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.400844 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.401554 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.402016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.402476 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.402959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.403432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.403950 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.404486 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.405021 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.405486 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.405952 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.406458 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.406912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.407371 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.407840 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.408352 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.408868 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.409496 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.410093 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.410677 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.411473 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.412046 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.412685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.413289 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.413973 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.414669 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.415111 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.415733 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.416353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.416905 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.417652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.418071 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.418594 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.419167 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.419780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.420414 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.421000 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.421568 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.422381 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.423028 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.423617 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.424234 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.424846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.425423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.425992 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.426568 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.427146 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.427848 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.428310 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.428916 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.429555 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.430143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.430736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.431357 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.431998 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.432682 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.433279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.433862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.434529 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.435186 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.435821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.436482 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.437075 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.437656 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.438221 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:26.438665 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:19:26.646597 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: WARNING keystonemiddleware.auth_token [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:19:26.656052 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: WARNING keystonemiddleware.auth_token [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:19:26.696818 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO dbcounter [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Registered counter for database nova_api Aug 31 00:19:26.731673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:26.739877 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writer thread running {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:26.808004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.context [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5fd1dd09-69f2-4bc1-8110-3d087c5f7a55(cell1) {{(pid=127118) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:19:26.812224 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.812743 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.814466 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:26.815284 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.815741 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.817869 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:26.820062 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO dbcounter [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Registered counter for database nova_cell0 Aug 31 00:19:26.826109 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO dbcounter [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Registered counter for database nova_cell1 Aug 31 00:19:26.839544 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:26.841002 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:26.848403 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writer thread running {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:26.850201 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writer thread running {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:27.024425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO dbcounter [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Registered counter for database nova_cell0 Aug 31 00:19:27.038096 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:27.049628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writer thread running {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:27.052692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: WARNING keystonemiddleware.auth_token [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:19:27.059580 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: WARNING keystonemiddleware.auth_token [None req-22a1f2d1-3c8c-428c-80e5-e735a1fd0fc8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:19:27.066589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556d62f4c9c0 pid: 127117 (default app) Aug 31 00:19:27.509718 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: WARNING keystonemiddleware.auth_token [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:19:27.518063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: WARNING keystonemiddleware.auth_token [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:19:27.919147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: WARNING keystonemiddleware.auth_token [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:19:27.925598 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: WARNING keystonemiddleware.auth_token [None req-fb7fb568-8215-4170-a3a0-423901ee01eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:19:27.931915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556d62f4c9c0 pid: 127118 (default app) Aug 31 00:20:19.848189 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=3 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:19.850747 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=3 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:19.858350 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=3 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:19.860101 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=3 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:20.934332 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8e564b4e-61ff-47fa-ba4b-ed8078ae7061 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Action: 'create', calling method: .version_select at 0x7f1a3b981ee0>, body: {"keypair": {"name": "tempest-keypair-852679302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZxCyjuQeTSkQcb7iyZF3gMDHS6hS2dg2P4MmvbCk58kzkFzPpfSNsqYGH7kwLACV1nP2HlUWUevJyyVfrWBujL3BJ6Rce6o/9IVOMGyUSF4B245KOH4l83nahhSRcjMA=="}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:21.023974 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-8e564b4e-61ff-47fa-ba4b-ed8078ae7061 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Getting quotas for project 5d71e648b9ff42fb8b29beabe01a5512. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:21.038838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-8e564b4e-61ff-47fa-ba4b-ed8078ae7061 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Getting quotas for user bc018a253e0a4b0bb96097ce4cc72c21 and project 5d71e648b9ff42fb8b29beabe01a5512. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:21.170987 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8e564b4e-61ff-47fa-ba4b-ed8078ae7061 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.357193 Aug 31 00:20:21.184797 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 31 00:20:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:30.275934 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=3 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:30.280048 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=3 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:30.284257 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=3 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:30.292057 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=3 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:30.669820 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cb18ad97-31be-4609-aba6-8adc81971607 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Action: 'create', calling method: .version_select at 0x7f1a3b817430>, body: {"keypair": {"name": "tempest-keypair-2067739810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIcG9wNHIXUXgzSuNXaSvYkUhKUXVDrT6Q4E/T6PXR230DNd4CxzUqVaZk4DU2xbiX582y/nH1FvGg42JHk2yjK/wGzyBD+LFlKBVcbJ5ceDBFB+tlcUcPcH3A84TONZQ=="}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:30.713540 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-cb18ad97-31be-4609-aba6-8adc81971607 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Getting quotas for project e53c8a6e81fe48d5b9609b921283e64d. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:30.742084 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-cb18ad97-31be-4609-aba6-8adc81971607 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Getting quotas for user 08fa033114244fc89c82939202f911e7 and project e53c8a6e81fe48d5b9609b921283e64d. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:30.881473 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cb18ad97-31be-4609-aba6-8adc81971607 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.570258 Aug 31 00:20:30.886520 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 2/2] 10.222.0.47 () {62 vars in 1200 bytes} [Wed Aug 31 00:20:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 578 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 00:20:30.955081 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-992061734", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d68da4d-e52e-4644-8ba2-67d235ba58ef"}], "security_groups": [{"name": "tempest-securitygroup--961529157"}], "key_name": "tempest-keypair-852679302", "user_data": "}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:32.794312 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.network.neutron [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] validate_networks() for [('9d68da4d-e52e-4644-8ba2-67d235ba58ef', None, None, None, None, None)] {{(pid=127118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:36.290509 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Flavor limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:36.291190 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Image limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:36.291832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Flavor pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:36.292408 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Image pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:36.292965 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:36.340109 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:36.344196 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:36.345587 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:36.348164 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:36.353209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:36.353824 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:36.445003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Getting quotas for project 5d71e648b9ff42fb8b29beabe01a5512. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:36.455351 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Getting quotas for user bc018a253e0a4b0bb96097ce4cc72c21 and project 5d71e648b9ff42fb8b29beabe01a5512. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:36.481916 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Going to run 1 instances... {{(pid=127118) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:36.487872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:36.609403 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-db2e7b3e-4f7a-4309-9669-cd03385bd580 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.346205 Aug 31 00:20:36.617467 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 6357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:20:36.622544 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-50a06606-8275-4b56-9d34-ec85ee5952a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:36.623397 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-50a06606-8275-4b56-9d34-ec85ee5952a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:37.422030 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-901032159", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b7c3317-0ec5-4bcb-bb71-0099edaec3ef"}], "security_groups": [{"name": "tempest-securitygroup--417637933"}], "key_name": "tempest-keypair-2067739810", "user_data": "}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:37.836843 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.network.neutron [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] validate_networks() for [('6b7c3317-0ec5-4bcb-bb71-0099edaec3ef', None, None, None, None, None)] {{(pid=127118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:38.232473 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-50a06606-8275-4b56-9d34-ec85ee5952a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:38.277830 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-50a06606-8275-4b56-9d34-ec85ee5952a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1236 microversion: 2.1 time: 1.653947 Aug 31 00:20:38.284901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 3/4] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:36 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1236 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:39.872636 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Flavor limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:39.873758 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Image limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:39.874696 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Flavor pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:39.875773 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Image pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:39.876540 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:39.924029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:39.924964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:39.925909 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:39.932469 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:39.937984 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:39.938754 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:40.060440 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Getting quotas for project e53c8a6e81fe48d5b9609b921283e64d. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:40.073725 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Getting quotas for user 08fa033114244fc89c82939202f911e7 and project e53c8a6e81fe48d5b9609b921283e64d. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:40.119227 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Going to run 1 instances... {{(pid=127118) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:40.158329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:40.233705 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-513085295", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "networks": [{"uuid": "7e5df58c-a1bf-481a-a8ee-6a521508fdd0"}]}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:40.353693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8b626b36-f1c9-4feb-b3dd-a1c6d4d8d810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.936325 Aug 31 00:20:40.357912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 2/5] 10.222.0.47 () {62 vars in 1188 bytes} [Wed Aug 31 00:20:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2942 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 00:20:40.371038 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8457c035-3df2-4ff7-8b76-d869098e621a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:40.372586 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8457c035-3df2-4ff7-8b76-d869098e621a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:40.411920 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8457c035-3df2-4ff7-8b76-d869098e621a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:40.412568 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8457c035-3df2-4ff7-8b76-d869098e621a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:40.414413 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8457c035-3df2-4ff7-8b76-d869098e621a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:40.424277 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8457c035-3df2-4ff7-8b76-d869098e621a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:40.425215 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8457c035-3df2-4ff7-8b76-d869098e621a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:40.426593 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8457c035-3df2-4ff7-8b76-d869098e621a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:40.584196 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] validate_networks() for [('7e5df58c-a1bf-481a-a8ee-6a521508fdd0', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:41.371213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8457c035-3df2-4ff7-8b76-d869098e621a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:41.416006 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8457c035-3df2-4ff7-8b76-d869098e621a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1240 microversion: 2.1 time: 1.056635 Aug 31 00:20:41.436945 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 3/6] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:40 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1240 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:41.454357 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7660d43e-4a0d-4355-9a62-e2a5285e7099 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:41.463684 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7660d43e-4a0d-4355-9a62-e2a5285e7099 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:42.013011 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7660d43e-4a0d-4355-9a62-e2a5285e7099 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:42.063691 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7660d43e-4a0d-4355-9a62-e2a5285e7099 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:42.073963 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7660d43e-4a0d-4355-9a62-e2a5285e7099 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:42.081340 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7660d43e-4a0d-4355-9a62-e2a5285e7099 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1281 microversion: 2.20 time: 0.639727 Aug 31 00:20:42.103192 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 4/7] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:20:41 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1281 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:20:43.019719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-de6b2421-07e7-4c0d-b4f6-343d338bcd75 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: .version_select at 0x7f1a3ae84670>, body: {"keypair": {"name": "tempest-keypair-1384397367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvJSqCH0kmt9J2Z9kpxVnsxmTkrfp6vBnpaRMvayQA38aMPIyMPC+NYDBrUJyfJwD/KS2po/AqU41G045q0EaLG5EWH/CGSKwHXGPnNf1Cx206xxIRu/X1nygXEXleX8w=="}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:43.129273 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-de6b2421-07e7-4c0d-b4f6-343d338bcd75 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:43.151012 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-de6b2421-07e7-4c0d-b4f6-343d338bcd75 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for user b3da9d7af0fd4c1d99973e6b277b16d2 and project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:43.284527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-de6b2421-07e7-4c0d-b4f6-343d338bcd75 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.192858 Aug 31 00:20:43.303034 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 5/8] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 31 00:20:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:43.695603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:43.698744 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:43.698744 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:43.699960 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:43.702670 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:43.735415 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:43.736765 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:43.737997 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:43.740807 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:43.745716 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:43.746848 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:43.830888 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Getting quotas for project d3406349e71d4d96bd33248ce77d5066. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:43.839713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Getting quotas for user 2ae7c3709577481b8661ccd80369bd4a and project d3406349e71d4d96bd33248ce77d5066. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:43.868672 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:43.874739 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:43.916677 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-99007101", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:44.041593 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.network.neutron [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] validate_networks() for [('f5d24600-1d04-47b6-a84d-0a5669f6e4ab', None, None, None, None, None)] {{(pid=127118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:44.213800 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8b40c194-c555-4db0-b46d-0c317d7d7001 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.338783 Aug 31 00:20:44.216313 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 4/9] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 5346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:20:44.239023 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-62535542-8fd5-435b-9e22-28f3f0345b96 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:44.245390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-62535542-8fd5-435b-9e22-28f3f0345b96 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:44.291634 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62535542-8fd5-435b-9e22-28f3f0345b96 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:44.292689 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62535542-8fd5-435b-9e22-28f3f0345b96 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:44.293398 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62535542-8fd5-435b-9e22-28f3f0345b96 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:44.294406 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62535542-8fd5-435b-9e22-28f3f0345b96 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:44.296071 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62535542-8fd5-435b-9e22-28f3f0345b96 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:44.296982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62535542-8fd5-435b-9e22-28f3f0345b96 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:44.589603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-62535542-8fd5-435b-9e22-28f3f0345b96 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:44.617663 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-62535542-8fd5-435b-9e22-28f3f0345b96 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1288 microversion: 2.1 time: 0.387445 Aug 31 00:20:44.622559 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 5/10] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:44 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1288 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:44.634056 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:44.635002 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:44.696572 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:44.699570 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:44.708391 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:44.729032 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:44.730021 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:44.734638 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:45.541795 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:45.564855 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:45.573690 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:45.579801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4e4ee823-14b9-45ee-9285-5df6141d1687 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1285 microversion: 2.20 time: 0.953104 Aug 31 00:20:45.583595 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 6/11] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:20:44 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1285 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:20:45.609457 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-aa3facdb-c730-4348-96c5-782e6df0bd20 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:45.615882 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-aa3facdb-c730-4348-96c5-782e6df0bd20 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:45.975645 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-aa3facdb-c730-4348-96c5-782e6df0bd20 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:45.994159 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-aa3facdb-c730-4348-96c5-782e6df0bd20 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1214 microversion: 2.1 time: 0.407547 Aug 31 00:20:46.001773 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 7/12] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:45 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1214 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:46.019868 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-eb867576-8dc2-42fb-bc65-7876b49d75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:46.022298 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-eb867576-8dc2-42fb-bc65-7876b49d75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:46.053789 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eb867576-8dc2-42fb-bc65-7876b49d75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.054431 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eb867576-8dc2-42fb-bc65-7876b49d75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.057726 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eb867576-8dc2-42fb-bc65-7876b49d75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.062982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eb867576-8dc2-42fb-bc65-7876b49d75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.063825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eb867576-8dc2-42fb-bc65-7876b49d75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.065190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eb867576-8dc2-42fb-bc65-7876b49d75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.317786 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-eb867576-8dc2-42fb-bc65-7876b49d75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:46.329357 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-eb867576-8dc2-42fb-bc65-7876b49d75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1306 microversion: 2.1 time: 0.326345 Aug 31 00:20:46.347574 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 8/13] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:46 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1306 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:46.430093 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Flavor limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:46.430722 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Image limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:46.431221 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Flavor pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:46.432417 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Image pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:46.432855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:46.449173 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.450876 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.451571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.452751 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.453456 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.454144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.547362 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Getting quotas for project af873e6a013c457aa2407fb24423ddc1. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:46.572802 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Getting quotas for user f8ffd2d3c0c141118a7a9a5696c383e1 and project af873e6a013c457aa2407fb24423ddc1. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:46.600743 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Going to run 1 instances... {{(pid=127118) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:46.606733 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:46.630467 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:46.636145 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:46.676330 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.678312 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.679975 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.686130 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.687443 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.707346 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.792250 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a56bc51f-dcc2-4397-bf7c-09a9ebb83b2e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.486108 Aug 31 00:20:46.815178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 6/14] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 3510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:20:46.852665 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5320e867-dd6a-4b3d-9540-969dc07bce1c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:46.854377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5320e867-dd6a-4b3d-9540-969dc07bce1c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:47.210608 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:47.230590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:47.244908 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:47.263853 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1c557440-62a3-42a3-a6de-923ed8bb86d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1333 microversion: 2.20 time: 0.654183 Aug 31 00:20:47.283759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 9/15] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:20:46 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1333 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:20:47.311946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ecaa52b8-15cc-48e4-bb6d-202225ed9c30 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:47.313127 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ecaa52b8-15cc-48e4-bb6d-202225ed9c30 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:47.350567 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ecaa52b8-15cc-48e4-bb6d-202225ed9c30 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:47.351351 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ecaa52b8-15cc-48e4-bb6d-202225ed9c30 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:47.352219 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ecaa52b8-15cc-48e4-bb6d-202225ed9c30 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:47.353416 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ecaa52b8-15cc-48e4-bb6d-202225ed9c30 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:47.354962 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ecaa52b8-15cc-48e4-bb6d-202225ed9c30 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:47.356036 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ecaa52b8-15cc-48e4-bb6d-202225ed9c30 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:47.490905 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5320e867-dd6a-4b3d-9540-969dc07bce1c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:47.521143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5320e867-dd6a-4b3d-9540-969dc07bce1c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1220 microversion: 2.1 time: 0.703044 Aug 31 00:20:47.526734 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 7/16] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:46 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1220 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:47.551944 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-10680c21-2697-4550-a61f-0aaa10a89bf7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:47.555106 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-10680c21-2697-4550-a61f-0aaa10a89bf7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:47.608041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-10680c21-2697-4550-a61f-0aaa10a89bf7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:47.611904 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-10680c21-2697-4550-a61f-0aaa10a89bf7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:47.616438 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-10680c21-2697-4550-a61f-0aaa10a89bf7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:47.621193 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-10680c21-2697-4550-a61f-0aaa10a89bf7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:47.636306 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-10680c21-2697-4550-a61f-0aaa10a89bf7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:47.637321 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-10680c21-2697-4550-a61f-0aaa10a89bf7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:47.821112 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ecaa52b8-15cc-48e4-bb6d-202225ed9c30 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:47.860434 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ecaa52b8-15cc-48e4-bb6d-202225ed9c30 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1266 microversion: 2.1 time: 0.573317 Aug 31 00:20:47.864140 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 10/17] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:47 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1266 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:48.165295 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-791277378", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:48.414691 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] validate_networks() for [('f5d24600-1d04-47b6-a84d-0a5669f6e4ab', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:49.785420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-10680c21-2697-4550-a61f-0aaa10a89bf7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:49.817577 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-10680c21-2697-4550-a61f-0aaa10a89bf7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1294 microversion: 2.1 time: 2.286517 Aug 31 00:20:49.818935 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 8/18] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:47 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1294 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:49.881374 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:49.889638 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:49.953411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:49.953411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:49.953411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:49.953411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:49.954213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:49.954213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:50.742993 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:50.808580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:50.823638 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:50.829489 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b0ee61b7-1fec-4f83-b66f-3f57f25c3656 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1339 microversion: 2.20 time: 0.999479 Aug 31 00:20:50.833556 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 9/19] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:20:49 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1339 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:20:50.873238 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-18452a15-113b-41b4-848f-4aca11167b77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:50.874292 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-18452a15-113b-41b4-848f-4aca11167b77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:50.909343 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18452a15-113b-41b4-848f-4aca11167b77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:50.918663 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18452a15-113b-41b4-848f-4aca11167b77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:50.922849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18452a15-113b-41b4-848f-4aca11167b77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:50.923785 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18452a15-113b-41b4-848f-4aca11167b77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:50.942255 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18452a15-113b-41b4-848f-4aca11167b77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:50.942849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18452a15-113b-41b4-848f-4aca11167b77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.290191 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:53.291121 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:53.292064 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:53.292853 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:53.293833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:53.336374 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=5 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:53.373682 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=19 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:53.385982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:53.389892 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:53.390991 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.398699 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:53.400978 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:53.425790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.534105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Getting quotas for project af873e6a013c457aa2407fb24423ddc1. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:53.558580 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Getting quotas for user f8ffd2d3c0c141118a7a9a5696c383e1 and project af873e6a013c457aa2407fb24423ddc1. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:53.636637 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:53.641326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:53.977223 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-75b27769-6e80-4f4b-ae67-b94b64860761 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.821964 Aug 31 00:20:53.995553 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 5842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:20:54.040001 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-153763201", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "923db031-4095-45ac-869f-da21aba3a797"}], "security_groups": [{"name": "tempest-securitygroup--892924600"}], "key_name": "tempest-keypair-1384397367", "user_data": "}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:54.492304 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-18452a15-113b-41b4-848f-4aca11167b77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:54.502927 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-18452a15-113b-41b4-848f-4aca11167b77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1314 microversion: 2.1 time: 3.666440 Aug 31 00:20:54.504766 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 10/21] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:50 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1314 bytes in 3670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:54.514545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-09d619bd-aec2-4cb4-84cc-8e6ce7b2c9f8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:54.531470 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-09d619bd-aec2-4cb4-84cc-8e6ce7b2c9f8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:54.561406 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-09d619bd-aec2-4cb4-84cc-8e6ce7b2c9f8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:54.567533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-09d619bd-aec2-4cb4-84cc-8e6ce7b2c9f8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:54.567533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-09d619bd-aec2-4cb4-84cc-8e6ce7b2c9f8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:54.574802 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-09d619bd-aec2-4cb4-84cc-8e6ce7b2c9f8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:54.574802 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-09d619bd-aec2-4cb4-84cc-8e6ce7b2c9f8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:54.581430 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-09d619bd-aec2-4cb4-84cc-8e6ce7b2c9f8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:55.967528 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] validate_networks() for [('923db031-4095-45ac-869f-da21aba3a797', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:56.095103 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-09d619bd-aec2-4cb4-84cc-8e6ce7b2c9f8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:56.106398 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-09d619bd-aec2-4cb4-84cc-8e6ce7b2c9f8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1361 microversion: 2.1 time: 1.596998 Aug 31 00:20:56.106994 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 11/22] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:54 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1361 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:56.120329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:56.121240 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:56.139425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.140234 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.141724 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.142717 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.145613 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.146444 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.491716 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=6 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:57.500749 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=26 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:57.517791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.550803 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.555653 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.562423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-47192f69-3dde-4765-a598-9fe31014e62b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1339 microversion: 2.20 time: 1.450539 Aug 31 00:20:57.563074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 12/23] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:20:56 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1339 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:20:57.574477 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-02b553f3-070b-41f7-8ed2-75f18e5a0d33 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:57.578341 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-02b553f3-070b-41f7-8ed2-75f18e5a0d33 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:57.598368 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02b553f3-070b-41f7-8ed2-75f18e5a0d33 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.598880 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02b553f3-070b-41f7-8ed2-75f18e5a0d33 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.599401 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02b553f3-070b-41f7-8ed2-75f18e5a0d33 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.600573 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02b553f3-070b-41f7-8ed2-75f18e5a0d33 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.601056 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02b553f3-070b-41f7-8ed2-75f18e5a0d33 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.601499 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02b553f3-070b-41f7-8ed2-75f18e5a0d33 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.659704 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-02b553f3-070b-41f7-8ed2-75f18e5a0d33 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:59.702578 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-02b553f3-070b-41f7-8ed2-75f18e5a0d33 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1273 microversion: 2.1 time: 2.138013 Aug 31 00:20:59.703585 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 13/24] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:57 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1273 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:59.747213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-345c98dd-b551-42c8-a67e-c98d093cea94 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:59.748351 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-345c98dd-b551-42c8-a67e-c98d093cea94 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:59.785645 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-345c98dd-b551-42c8-a67e-c98d093cea94 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.797445 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-345c98dd-b551-42c8-a67e-c98d093cea94 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.798936 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-345c98dd-b551-42c8-a67e-c98d093cea94 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.806943 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-345c98dd-b551-42c8-a67e-c98d093cea94 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.808543 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-345c98dd-b551-42c8-a67e-c98d093cea94 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.809647 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-345c98dd-b551-42c8-a67e-c98d093cea94 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.471424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-345c98dd-b551-42c8-a67e-c98d093cea94 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.479481 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=53 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:01.485398 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-345c98dd-b551-42c8-a67e-c98d093cea94 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1314 microversion: 2.1 time: 1.770993 Aug 31 00:21:01.489004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 14/25] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:59 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1314 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:01.498470 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e77eafd0-3f77-4e7f-b83c-18be6e65ebc0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:01.505013 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e77eafd0-3f77-4e7f-b83c-18be6e65ebc0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:01.513027 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:01.522857 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e77eafd0-3f77-4e7f-b83c-18be6e65ebc0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.523907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e77eafd0-3f77-4e7f-b83c-18be6e65ebc0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.525988 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e77eafd0-3f77-4e7f-b83c-18be6e65ebc0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.527291 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e77eafd0-3f77-4e7f-b83c-18be6e65ebc0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.529131 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e77eafd0-3f77-4e7f-b83c-18be6e65ebc0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.530229 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e77eafd0-3f77-4e7f-b83c-18be6e65ebc0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.726911 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:21:01.729534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:21:01.730743 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:21:01.734232 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:21:01.741133 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:21:01.821808 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.822771 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.823640 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.842837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.843743 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.854372 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.982038 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:21:02.004843 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for user b3da9d7af0fd4c1d99973e6b277b16d2 and project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:21:02.043483 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:21:02.048797 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:21:02.198424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4acf5164-64d3-48cc-9642-dbeccbb126b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 8.196135 Aug 31 00:21:02.213741 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 12/26] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 8213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:21:02.229178 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:02.230132 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:02.240240 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.241012 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.242477 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.244433 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.245365 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.246021 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.455028 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e77eafd0-3f77-4e7f-b83c-18be6e65ebc0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.485268 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e77eafd0-3f77-4e7f-b83c-18be6e65ebc0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1361 microversion: 2.1 time: 2.992649 Aug 31 00:21:04.505986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:01 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1361 bytes in 3016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:04.631666 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.705845 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.709710 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.718663 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cce1d55e-1146-421e-8ecf-c53dc46218c3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1406 microversion: 2.20 time: 2.503691 Aug 31 00:21:04.719940 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 13/28] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:02 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1406 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:04.734987 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1f8ef448-31b9-4034-8dda-315186965e56 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:04.747438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1f8ef448-31b9-4034-8dda-315186965e56 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:04.791075 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f8ef448-31b9-4034-8dda-315186965e56 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.797223 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f8ef448-31b9-4034-8dda-315186965e56 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.801123 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f8ef448-31b9-4034-8dda-315186965e56 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.802677 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f8ef448-31b9-4034-8dda-315186965e56 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.803362 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f8ef448-31b9-4034-8dda-315186965e56 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.803807 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f8ef448-31b9-4034-8dda-315186965e56 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.204567 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-40515bec-f083-4f75-ae57-cd5024a987ba req-532a511d-79b0-4679-a164-ab61d51e4fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfccff9c-84bb-4098-b492-f54f05b3ebd1", "tag": "f1fa86d4-e574-414e-9f10-7f6572bb99f0"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:05.255780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-40515bec-f083-4f75-ae57-cd5024a987ba req-532a511d-79b0-4679-a164-ab61d51e4fea service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.263696 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-40515bec-f083-4f75-ae57-cd5024a987ba req-532a511d-79b0-4679-a164-ab61d51e4fea service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.264795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-40515bec-f083-4f75-ae57-cd5024a987ba req-532a511d-79b0-4679-a164-ab61d51e4fea service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.326961 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1f8ef448-31b9-4034-8dda-315186965e56 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:05.355396 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-40515bec-f083-4f75-ae57-cd5024a987ba req-532a511d-79b0-4679-a164-ab61d51e4fea service nova] Creating event network-changed:f1fa86d4-e574-414e-9f10-7f6572bb99f0 for instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 on hv-cinder-85221 Aug 31 00:21:05.358332 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1f8ef448-31b9-4034-8dda-315186965e56 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1279 microversion: 2.1 time: 0.634866 Aug 31 00:21:05.360890 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 14/29] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:04 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1279 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:05.370221 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-40515bec-f083-4f75-ae57-cd5024a987ba req-532a511d-79b0-4679-a164-ab61d51e4fea service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127118) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 00:21:05.371071 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-40515bec-f083-4f75-ae57-cd5024a987ba req-532a511d-79b0-4679-a164-ab61d51e4fea service nova] Acquired lock "compute-rpcapi-router" {{(pid=127118) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 00:21:05.373017 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0e3a75b-d5f7-4338-b43e-68fc8d830928 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.374179 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0e3a75b-d5f7-4338-b43e-68fc8d830928 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.375057 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0e3a75b-d5f7-4338-b43e-68fc8d830928 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.376591 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c4db02d2-d508-4c46-88bd-3f6b3caf8219 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:05.379657 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c4db02d2-d508-4c46-88bd-3f6b3caf8219 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:05.391213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0e3a75b-d5f7-4338-b43e-68fc8d830928 None None] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.392260 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0e3a75b-d5f7-4338-b43e-68fc8d830928 None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.393046 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0e3a75b-d5f7-4338-b43e-68fc8d830928 None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.394982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4db02d2-d508-4c46-88bd-3f6b3caf8219 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.396495 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4db02d2-d508-4c46-88bd-3f6b3caf8219 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.399155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4db02d2-d508-4c46-88bd-3f6b3caf8219 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.402184 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4db02d2-d508-4c46-88bd-3f6b3caf8219 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.403805 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4db02d2-d508-4c46-88bd-3f6b3caf8219 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.404694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4db02d2-d508-4c46-88bd-3f6b3caf8219 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.448206 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.compute.rpcapi [None req-a0e3a75b-d5f7-4338-b43e-68fc8d830928 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 00:21:05.452636 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0e3a75b-d5f7-4338-b43e-68fc8d830928 None None] Releasing lock "compute-rpcapi-router" {{(pid=127118) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 00:21:05.489198 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a0e3a75b-d5f7-4338-b43e-68fc8d830928 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.980263 Aug 31 00:21:05.492861 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 16/30] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:05.503147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7eec4faa-a2c4-4661-822c-605e82a0912a tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:05.504496 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7eec4faa-a2c4-4661-822c-605e82a0912a tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:05.519678 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7eec4faa-a2c4-4661-822c-605e82a0912a tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.520944 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7eec4faa-a2c4-4661-822c-605e82a0912a tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.521930 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7eec4faa-a2c4-4661-822c-605e82a0912a tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.523242 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7eec4faa-a2c4-4661-822c-605e82a0912a tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.526673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7eec4faa-a2c4-4661-822c-605e82a0912a tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.527793 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7eec4faa-a2c4-4661-822c-605e82a0912a tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.910478 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c4db02d2-d508-4c46-88bd-3f6b3caf8219 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:05.928545 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c4db02d2-d508-4c46-88bd-3f6b3caf8219 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1293 microversion: 2.1 time: 0.562286 Aug 31 00:21:05.933587 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 15/31] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:05 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1293 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:06.386120 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-a4a4ea57-c441-42ec-b512-175a9799cdfb req-ed13e69c-ef40-467d-9460-519991ccc4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e22ddf8-4065-4933-a8db-68b53f82a42e", "tag": "6317fbd6-92fd-41d8-a8a9-21faad23ff44"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:06.390524 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7eec4faa-a2c4-4661-822c-605e82a0912a tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.402964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7eec4faa-a2c4-4661-822c-605e82a0912a tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1314 microversion: 2.1 time: 0.908253 Aug 31 00:21:06.407424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a4a4ea57-c441-42ec-b512-175a9799cdfb req-ed13e69c-ef40-467d-9460-519991ccc4e6 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.407913 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a4a4ea57-c441-42ec-b512-175a9799cdfb req-ed13e69c-ef40-467d-9460-519991ccc4e6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.408789 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a4a4ea57-c441-42ec-b512-175a9799cdfb req-ed13e69c-ef40-467d-9460-519991ccc4e6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.418687 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 17/32] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:05 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:06.424015 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-6be195f1-638d-4f05-91d2-7feb28edf7bb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:06.424698 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-6be195f1-638d-4f05-91d2-7feb28edf7bb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:06.446007 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6be195f1-638d-4f05-91d2-7feb28edf7bb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.446732 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6be195f1-638d-4f05-91d2-7feb28edf7bb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.447352 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6be195f1-638d-4f05-91d2-7feb28edf7bb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.448330 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6be195f1-638d-4f05-91d2-7feb28edf7bb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.449056 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6be195f1-638d-4f05-91d2-7feb28edf7bb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.449826 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6be195f1-638d-4f05-91d2-7feb28edf7bb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.454767 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-a4a4ea57-c441-42ec-b512-175a9799cdfb req-ed13e69c-ef40-467d-9460-519991ccc4e6 service nova] Creating event network-changed:6317fbd6-92fd-41d8-a8a9-21faad23ff44 for instance 1e22ddf8-4065-4933-a8db-68b53f82a42e on hv-cinder-85221 Aug 31 00:21:06.455353 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a4a4ea57-c441-42ec-b512-175a9799cdfb req-ed13e69c-ef40-467d-9460-519991ccc4e6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127117) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 00:21:06.455795 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a4a4ea57-c441-42ec-b512-175a9799cdfb req-ed13e69c-ef40-467d-9460-519991ccc4e6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127117) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 00:21:06.458589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9cf0e7a0-ad3f-4e5f-add5-7f3e685267e0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.459364 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9cf0e7a0-ad3f-4e5f-add5-7f3e685267e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.464089 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9cf0e7a0-ad3f-4e5f-add5-7f3e685267e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.466025 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9cf0e7a0-ad3f-4e5f-add5-7f3e685267e0 None None] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.474689 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9cf0e7a0-ad3f-4e5f-add5-7f3e685267e0 None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.476255 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9cf0e7a0-ad3f-4e5f-add5-7f3e685267e0 None None] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.497775 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.compute.rpcapi [None req-9cf0e7a0-ad3f-4e5f-add5-7f3e685267e0 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 00:21:06.503341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9cf0e7a0-ad3f-4e5f-add5-7f3e685267e0 None None] Releasing lock "compute-rpcapi-router" {{(pid=127117) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 00:21:06.531400 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9cf0e7a0-ad3f-4e5f-add5-7f3e685267e0 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.596081 Aug 31 00:21:06.532077 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 16/33] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:06.541777 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:06.542484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:06.556145 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.556654 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.557288 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.558066 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.558529 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.558952 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.882539 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-6be195f1-638d-4f05-91d2-7feb28edf7bb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.890106 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.895096 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-6be195f1-638d-4f05-91d2-7feb28edf7bb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1361 microversion: 2.1 time: 0.475082 Aug 31 00:21:06.899470 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.900266 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 18/34] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:06 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1361 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:06.901089 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.902256 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-18dc6616-0a31-422d-ba4f-f4b7baeee5e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1406 microversion: 2.20 time: 0.366711 Aug 31 00:21:06.902836 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 17/35] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:06 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1406 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:06.907142 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-dad527c2-e274-4bf2-bc7f-0c0273a7de5a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:06.907763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-dad527c2-e274-4bf2-bc7f-0c0273a7de5a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:06.916111 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dad527c2-e274-4bf2-bc7f-0c0273a7de5a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.918794 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dad527c2-e274-4bf2-bc7f-0c0273a7de5a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.924983 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dad527c2-e274-4bf2-bc7f-0c0273a7de5a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.925930 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dad527c2-e274-4bf2-bc7f-0c0273a7de5a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.926416 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dad527c2-e274-4bf2-bc7f-0c0273a7de5a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.926894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dad527c2-e274-4bf2-bc7f-0c0273a7de5a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.975308 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ca17ce84-3887-44f4-a9aa-f9121e15e43e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:06.976782 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ca17ce84-3887-44f4-a9aa-f9121e15e43e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:06.990413 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca17ce84-3887-44f4-a9aa-f9121e15e43e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.990687 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca17ce84-3887-44f4-a9aa-f9121e15e43e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.994725 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca17ce84-3887-44f4-a9aa-f9121e15e43e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.995781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca17ce84-3887-44f4-a9aa-f9121e15e43e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.996540 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca17ce84-3887-44f4-a9aa-f9121e15e43e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.997241 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca17ce84-3887-44f4-a9aa-f9121e15e43e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.154512 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ca17ce84-3887-44f4-a9aa-f9121e15e43e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.170738 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ca17ce84-3887-44f4-a9aa-f9121e15e43e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1311 microversion: 2.1 time: 0.201640 Aug 31 00:21:07.191465 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 18/36] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:06 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1311 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:07.426514 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-604498bb-9c84-4679-9adf-1ca1826306c1 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:07.428086 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-604498bb-9c84-4679-9adf-1ca1826306c1 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:07.439915 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-604498bb-9c84-4679-9adf-1ca1826306c1 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.446096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-604498bb-9c84-4679-9adf-1ca1826306c1 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.449083 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-604498bb-9c84-4679-9adf-1ca1826306c1 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.450081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-604498bb-9c84-4679-9adf-1ca1826306c1 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.451989 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-604498bb-9c84-4679-9adf-1ca1826306c1 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.453176 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-604498bb-9c84-4679-9adf-1ca1826306c1 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.495134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-dad527c2-e274-4bf2-bc7f-0c0273a7de5a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.529481 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-dad527c2-e274-4bf2-bc7f-0c0273a7de5a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1321 microversion: 2.1 time: 0.627441 Aug 31 00:21:07.547271 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 19/37] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:06 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1321 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:07.922683 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2a778659-728d-4f1b-9d35-296a51342b71 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:07.923735 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2a778659-728d-4f1b-9d35-296a51342b71 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:07.936062 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a778659-728d-4f1b-9d35-296a51342b71 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.936871 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a778659-728d-4f1b-9d35-296a51342b71 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.939595 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a778659-728d-4f1b-9d35-296a51342b71 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.940382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a778659-728d-4f1b-9d35-296a51342b71 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.941409 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a778659-728d-4f1b-9d35-296a51342b71 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.941872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a778659-728d-4f1b-9d35-296a51342b71 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.026722 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-604498bb-9c84-4679-9adf-1ca1826306c1 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.055811 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-604498bb-9c84-4679-9adf-1ca1826306c1 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1314 microversion: 2.1 time: 1.633147 Aug 31 00:21:09.062699 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 19/38] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:07 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1314 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:09.086219 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:09.088756 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:09.102939 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.104004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.104920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.107432 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.119441 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.121530 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.201307 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2a778659-728d-4f1b-9d35-296a51342b71 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.229184 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2a778659-728d-4f1b-9d35-296a51342b71 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1361 microversion: 2.1 time: 1.310520 Aug 31 00:21:09.235756 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 20/39] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:07 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1361 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:09.257378 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3dc6810e-4e3f-4263-b4a1-efe66388a4bc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:09.258467 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3dc6810e-4e3f-4263-b4a1-efe66388a4bc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:09.298158 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3dc6810e-4e3f-4263-b4a1-efe66388a4bc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.311731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3dc6810e-4e3f-4263-b4a1-efe66388a4bc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.317406 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3dc6810e-4e3f-4263-b4a1-efe66388a4bc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.319529 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3dc6810e-4e3f-4263-b4a1-efe66388a4bc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.321071 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3dc6810e-4e3f-4263-b4a1-efe66388a4bc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.322351 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3dc6810e-4e3f-4263-b4a1-efe66388a4bc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.610349 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3dc6810e-4e3f-4263-b4a1-efe66388a4bc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.626137 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3dc6810e-4e3f-4263-b4a1-efe66388a4bc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1299 microversion: 2.1 time: 0.387023 Aug 31 00:21:09.628524 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 21/40] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:09 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1299 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:09.638657 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-97d15cf3-eb1b-42ee-92f7-46cc7bfd0550 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:09.639810 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-97d15cf3-eb1b-42ee-92f7-46cc7bfd0550 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:09.657805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-97d15cf3-eb1b-42ee-92f7-46cc7bfd0550 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.658694 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-97d15cf3-eb1b-42ee-92f7-46cc7bfd0550 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.661292 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-97d15cf3-eb1b-42ee-92f7-46cc7bfd0550 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.662342 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-97d15cf3-eb1b-42ee-92f7-46cc7bfd0550 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.663940 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-97d15cf3-eb1b-42ee-92f7-46cc7bfd0550 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.664670 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-97d15cf3-eb1b-42ee-92f7-46cc7bfd0550 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.860374 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.890610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.897391 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.900465 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a12099e1-a448-4a4f-9cf9-78206e784918 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1406 microversion: 2.20 time: 0.832078 Aug 31 00:21:09.902355 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:09 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1406 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:09.918867 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-5e28babb-1dfe-4540-a98a-ddfbc8d721a4 req-25517659-0f78-4dd2-b3e1-9c4dbadfe635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a312d8-6cb2-4da8-a19b-215372294799", "tag": "0ff0dbfa-0c17-4d1f-bc12-fdd58530b639"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:09.959989 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-5e28babb-1dfe-4540-a98a-ddfbc8d721a4 req-25517659-0f78-4dd2-b3e1-9c4dbadfe635 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.961632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-5e28babb-1dfe-4540-a98a-ddfbc8d721a4 req-25517659-0f78-4dd2-b3e1-9c4dbadfe635 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.962824 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-5e28babb-1dfe-4540-a98a-ddfbc8d721a4 req-25517659-0f78-4dd2-b3e1-9c4dbadfe635 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.003009 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-5e28babb-1dfe-4540-a98a-ddfbc8d721a4 req-25517659-0f78-4dd2-b3e1-9c4dbadfe635 service nova] Creating event network-changed:0ff0dbfa-0c17-4d1f-bc12-fdd58530b639 for instance e3a312d8-6cb2-4da8-a19b-215372294799 on hv-cinder-85221 Aug 31 00:21:10.011978 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-5e28babb-1dfe-4540-a98a-ddfbc8d721a4 req-25517659-0f78-4dd2-b3e1-9c4dbadfe635 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106722 Aug 31 00:21:10.012869 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 21/42] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:10.018052 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-3d8c38e4-3493-4267-961e-86d654dd00cf req-b578d5e7-bb0d-44fa-bca7-5529ccbbedfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f274203-f40e-4cc4-b0c6-a181fb704311", "tag": "eadb7db5-44a8-41e0-ac9f-63b1573f5a39"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:10.029862 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-3d8c38e4-3493-4267-961e-86d654dd00cf req-b578d5e7-bb0d-44fa-bca7-5529ccbbedfc service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.030938 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-3d8c38e4-3493-4267-961e-86d654dd00cf req-b578d5e7-bb0d-44fa-bca7-5529ccbbedfc service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.030938 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-3d8c38e4-3493-4267-961e-86d654dd00cf req-b578d5e7-bb0d-44fa-bca7-5529ccbbedfc service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.043359 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-3d8c38e4-3493-4267-961e-86d654dd00cf req-b578d5e7-bb0d-44fa-bca7-5529ccbbedfc service nova] Creating event network-changed:eadb7db5-44a8-41e0-ac9f-63b1573f5a39 for instance 1f274203-f40e-4cc4-b0c6-a181fb704311 on hv-cinder-85221 Aug 31 00:21:10.048837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-3d8c38e4-3493-4267-961e-86d654dd00cf req-b578d5e7-bb0d-44fa-bca7-5529ccbbedfc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034739 Aug 31 00:21:10.049456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 22/43] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:10.091025 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-0db08516-984a-433a-bcde-40558311c133 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:10.096993 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-0db08516-984a-433a-bcde-40558311c133 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:10.113703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0db08516-984a-433a-bcde-40558311c133 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.115128 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0db08516-984a-433a-bcde-40558311c133 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.116081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0db08516-984a-433a-bcde-40558311c133 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.118940 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0db08516-984a-433a-bcde-40558311c133 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.121006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0db08516-984a-433a-bcde-40558311c133 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.122483 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0db08516-984a-433a-bcde-40558311c133 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.826175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-97d15cf3-eb1b-42ee-92f7-46cc7bfd0550 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:10.836445 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-97d15cf3-eb1b-42ee-92f7-46cc7bfd0550 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1321 microversion: 2.1 time: 1.206324 Aug 31 00:21:10.837969 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 22/44] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:09 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1321 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:10.845938 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b0391222-5f35-45c7-ba3d-f0bcf24336ac tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:10.846897 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b0391222-5f35-45c7-ba3d-f0bcf24336ac tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:10.855403 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0391222-5f35-45c7-ba3d-f0bcf24336ac tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.856440 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0391222-5f35-45c7-ba3d-f0bcf24336ac tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.857215 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0391222-5f35-45c7-ba3d-f0bcf24336ac tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.858350 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0391222-5f35-45c7-ba3d-f0bcf24336ac tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.859117 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0391222-5f35-45c7-ba3d-f0bcf24336ac tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.859767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b0391222-5f35-45c7-ba3d-f0bcf24336ac tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.365678 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-0db08516-984a-433a-bcde-40558311c133 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:11.368685 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=91 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:11.376375 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-0db08516-984a-433a-bcde-40558311c133 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1314 microversion: 2.1 time: 1.293334 Aug 31 00:21:11.392612 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 23/45] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:10 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1314 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:11.413960 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f0265306-f569-4317-b681-ab5d74d8c1d7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:11.415205 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f0265306-f569-4317-b681-ab5d74d8c1d7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:11.430247 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0265306-f569-4317-b681-ab5d74d8c1d7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.431491 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0265306-f569-4317-b681-ab5d74d8c1d7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.434639 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0265306-f569-4317-b681-ab5d74d8c1d7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.436257 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0265306-f569-4317-b681-ab5d74d8c1d7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.462086 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0265306-f569-4317-b681-ab5d74d8c1d7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.463683 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0265306-f569-4317-b681-ab5d74d8c1d7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.889781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f0265306-f569-4317-b681-ab5d74d8c1d7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:11.909666 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f0265306-f569-4317-b681-ab5d74d8c1d7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1299 microversion: 2.1 time: 0.505599 Aug 31 00:21:11.912225 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 24/46] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:11 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1299 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:11.962286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:11.962899 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:11.969773 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.970589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.971341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.972439 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.973100 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.973809 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.031654 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=11 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:12.619813 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b0391222-5f35-45c7-ba3d-f0bcf24336ac tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.629033 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b0391222-5f35-45c7-ba3d-f0bcf24336ac tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1361 microversion: 2.1 time: 1.789427 Aug 31 00:21:12.640516 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 23/47] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:10 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1361 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:12.647468 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0a96f6ab-27dc-45b5-9c3e-e6757bf3b2f1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:12.648327 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0a96f6ab-27dc-45b5-9c3e-e6757bf3b2f1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:12.658783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a96f6ab-27dc-45b5-9c3e-e6757bf3b2f1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.668955 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a96f6ab-27dc-45b5-9c3e-e6757bf3b2f1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.669360 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a96f6ab-27dc-45b5-9c3e-e6757bf3b2f1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.670473 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a96f6ab-27dc-45b5-9c3e-e6757bf3b2f1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.671136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a96f6ab-27dc-45b5-9c3e-e6757bf3b2f1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.671938 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a96f6ab-27dc-45b5-9c3e-e6757bf3b2f1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.097451 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.109873 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.112911 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.114096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-71af4671-0083-42d9-8e39-3a6e1698cfca tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1406 microversion: 2.20 time: 1.199899 Aug 31 00:21:13.115808 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 25/48] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:11 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1406 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:13.125466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-b9071717-941a-45fa-aca1-8cf4f7327eff req-9f2f3d55-cd27-431d-9370-66d92a5e4484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "379d25b6-01b5-4bed-ba25-2f169d66600b", "tag": "b667fe99-0903-42b3-8838-53300f0a504b"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:13.151133 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-b9071717-941a-45fa-aca1-8cf4f7327eff req-9f2f3d55-cd27-431d-9370-66d92a5e4484 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.152476 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-b9071717-941a-45fa-aca1-8cf4f7327eff req-9f2f3d55-cd27-431d-9370-66d92a5e4484 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.153126 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-b9071717-941a-45fa-aca1-8cf4f7327eff req-9f2f3d55-cd27-431d-9370-66d92a5e4484 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.170644 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-b9071717-941a-45fa-aca1-8cf4f7327eff req-9f2f3d55-cd27-431d-9370-66d92a5e4484 service nova] Creating event network-changed:b667fe99-0903-42b3-8838-53300f0a504b for instance 379d25b6-01b5-4bed-ba25-2f169d66600b on hv-cinder-85221 Aug 31 00:21:13.176118 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-b9071717-941a-45fa-aca1-8cf4f7327eff req-9f2f3d55-cd27-431d-9370-66d92a5e4484 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058222 Aug 31 00:21:13.178475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 26/49] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:13.184002 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c8400d26-7d13-4c01-8a99-d0ae6e850c65 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:13.184987 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c8400d26-7d13-4c01-8a99-d0ae6e850c65 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:13.197023 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c8400d26-7d13-4c01-8a99-d0ae6e850c65 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.197985 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c8400d26-7d13-4c01-8a99-d0ae6e850c65 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.198662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c8400d26-7d13-4c01-8a99-d0ae6e850c65 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.199781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c8400d26-7d13-4c01-8a99-d0ae6e850c65 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.200474 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c8400d26-7d13-4c01-8a99-d0ae6e850c65 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.201156 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c8400d26-7d13-4c01-8a99-d0ae6e850c65 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.206581 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0a96f6ab-27dc-45b5-9c3e-e6757bf3b2f1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.220601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0a96f6ab-27dc-45b5-9c3e-e6757bf3b2f1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1321 microversion: 2.1 time: 0.577849 Aug 31 00:21:13.222094 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 24/50] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:12 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1321 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:13.355481 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-d1b05c95-5234-4ea8-87c0-99942232a433 req-9a2755bf-4eb4-4d7e-a751-bd6cee369826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfccff9c-84bb-4098-b492-f54f05b3ebd1", "name": "network-vif-plugged", "status": "completed", "tag": "f1fa86d4-e574-414e-9f10-7f6572bb99f0"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:13.367265 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-d1b05c95-5234-4ea8-87c0-99942232a433 req-9a2755bf-4eb4-4d7e-a751-bd6cee369826 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.368438 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-d1b05c95-5234-4ea8-87c0-99942232a433 req-9a2755bf-4eb4-4d7e-a751-bd6cee369826 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.369102 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-d1b05c95-5234-4ea8-87c0-99942232a433 req-9a2755bf-4eb4-4d7e-a751-bd6cee369826 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.391239 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-d1b05c95-5234-4ea8-87c0-99942232a433 req-9a2755bf-4eb4-4d7e-a751-bd6cee369826 service nova] Creating event network-vif-plugged:f1fa86d4-e574-414e-9f10-7f6572bb99f0 for instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 on hv-cinder-85221 Aug 31 00:21:13.402854 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-d1b05c95-5234-4ea8-87c0-99942232a433 req-9a2755bf-4eb4-4d7e-a751-bd6cee369826 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175195 Aug 31 00:21:13.404259 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 25/51] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:13.420451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0625b6f7-f3b5-4f9d-b708-d945424d4feb tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:13.422928 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0625b6f7-f3b5-4f9d-b708-d945424d4feb tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:13.453164 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0625b6f7-f3b5-4f9d-b708-d945424d4feb tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.455469 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0625b6f7-f3b5-4f9d-b708-d945424d4feb tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.456964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0625b6f7-f3b5-4f9d-b708-d945424d4feb tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.460246 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0625b6f7-f3b5-4f9d-b708-d945424d4feb tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.460802 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0625b6f7-f3b5-4f9d-b708-d945424d4feb tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.461247 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0625b6f7-f3b5-4f9d-b708-d945424d4feb tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.693674 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c8400d26-7d13-4c01-8a99-d0ae6e850c65 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.705110 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c8400d26-7d13-4c01-8a99-d0ae6e850c65 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1314 microversion: 2.1 time: 0.525064 Aug 31 00:21:13.725032 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 27/52] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:13 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:13.737515 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7824c0af-46bb-45ad-a818-d291da96aa36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:13.740575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7824c0af-46bb-45ad-a818-d291da96aa36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:13.753190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7824c0af-46bb-45ad-a818-d291da96aa36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.756927 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7824c0af-46bb-45ad-a818-d291da96aa36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.757555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7824c0af-46bb-45ad-a818-d291da96aa36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.758469 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7824c0af-46bb-45ad-a818-d291da96aa36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.759138 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7824c0af-46bb-45ad-a818-d291da96aa36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.759732 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7824c0af-46bb-45ad-a818-d291da96aa36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.402054 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0625b6f7-f3b5-4f9d-b708-d945424d4feb tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:14.433423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0625b6f7-f3b5-4f9d-b708-d945424d4feb tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 1.027272 Aug 31 00:21:14.439114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 26/53] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:13 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:14.471619 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:14.473341 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:14.496925 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.497803 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.498783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.500373 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.504569 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.506505 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.709178 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7824c0af-46bb-45ad-a818-d291da96aa36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:14.760027 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7824c0af-46bb-45ad-a818-d291da96aa36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1361 microversion: 2.1 time: 1.035794 Aug 31 00:21:14.763375 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 28/54] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:13 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1361 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:14.786797 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8c83035c-ec04-4119-84d0-6e4efde74739 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:14.790242 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8c83035c-ec04-4119-84d0-6e4efde74739 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:14.820295 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8c83035c-ec04-4119-84d0-6e4efde74739 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.835434 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8c83035c-ec04-4119-84d0-6e4efde74739 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.847498 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8c83035c-ec04-4119-84d0-6e4efde74739 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.849461 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8c83035c-ec04-4119-84d0-6e4efde74739 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.851041 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8c83035c-ec04-4119-84d0-6e4efde74739 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.853862 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8c83035c-ec04-4119-84d0-6e4efde74739 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:15.446156 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:15.762856 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:15.778019 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:15.780744 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:15.782723 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7b6e1922-3eea-4961-b992-6a5245da6492 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1406 microversion: 2.20 time: 1.340566 Aug 31 00:21:15.784293 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 27/55] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:14 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1406 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:15.799078 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-6c4b7cd1-6253-4993-b154-c5506861e773 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:15.799990 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-6c4b7cd1-6253-4993-b154-c5506861e773 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:15.807174 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6c4b7cd1-6253-4993-b154-c5506861e773 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:15.809552 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6c4b7cd1-6253-4993-b154-c5506861e773 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:15.810653 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6c4b7cd1-6253-4993-b154-c5506861e773 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:15.811550 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6c4b7cd1-6253-4993-b154-c5506861e773 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:15.812628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6c4b7cd1-6253-4993-b154-c5506861e773 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:15.813284 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6c4b7cd1-6253-4993-b154-c5506861e773 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:15.847672 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8c83035c-ec04-4119-84d0-6e4efde74739 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:15.881101 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8c83035c-ec04-4119-84d0-6e4efde74739 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1321 microversion: 2.1 time: 1.115043 Aug 31 00:21:15.882175 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 29/56] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:14 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1321 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:15.887455 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-f28e0fe6-bf67-44a6-8ab6-d68d1fdfafbc req-ecb95dcd-2d44-47f1-b99d-d1543214fcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e22ddf8-4065-4933-a8db-68b53f82a42e", "name": "network-vif-plugged", "status": "completed", "tag": "6317fbd6-92fd-41d8-a8a9-21faad23ff44"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:15.898642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f28e0fe6-bf67-44a6-8ab6-d68d1fdfafbc req-ecb95dcd-2d44-47f1-b99d-d1543214fcb1 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:15.899311 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f28e0fe6-bf67-44a6-8ab6-d68d1fdfafbc req-ecb95dcd-2d44-47f1-b99d-d1543214fcb1 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:15.899809 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f28e0fe6-bf67-44a6-8ab6-d68d1fdfafbc req-ecb95dcd-2d44-47f1-b99d-d1543214fcb1 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:15.915190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-f28e0fe6-bf67-44a6-8ab6-d68d1fdfafbc req-ecb95dcd-2d44-47f1-b99d-d1543214fcb1 service nova] Creating event network-vif-plugged:6317fbd6-92fd-41d8-a8a9-21faad23ff44 for instance 1e22ddf8-4065-4933-a8db-68b53f82a42e on hv-cinder-85221 Aug 31 00:21:15.924651 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-f28e0fe6-bf67-44a6-8ab6-d68d1fdfafbc req-ecb95dcd-2d44-47f1-b99d-d1543214fcb1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040406 Aug 31 00:21:15.925798 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 30/57] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:15.934430 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a3e6dee1-8e78-405d-8aab-c3789d7f98a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:15.935432 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-a3e6dee1-8e78-405d-8aab-c3789d7f98a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:15.944032 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3e6dee1-8e78-405d-8aab-c3789d7f98a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:15.944032 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3e6dee1-8e78-405d-8aab-c3789d7f98a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:15.944544 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3e6dee1-8e78-405d-8aab-c3789d7f98a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:15.945440 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3e6dee1-8e78-405d-8aab-c3789d7f98a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:15.945894 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3e6dee1-8e78-405d-8aab-c3789d7f98a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:15.946317 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3e6dee1-8e78-405d-8aab-c3789d7f98a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.488945 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=8 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:16.828794 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-6c4b7cd1-6253-4993-b154-c5506861e773 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:16.854038 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-6c4b7cd1-6253-4993-b154-c5506861e773 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1314 microversion: 2.1 time: 1.067647 Aug 31 00:21:16.855145 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 28/58] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:15 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1314 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:16.876915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2fd47db5-2503-4391-8270-18c686b389d7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:16.883213 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a3e6dee1-8e78-405d-8aab-c3789d7f98a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:16.884342 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2fd47db5-2503-4391-8270-18c686b389d7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:16.893609 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fd47db5-2503-4391-8270-18c686b389d7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:16.894112 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fd47db5-2503-4391-8270-18c686b389d7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:16.894564 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fd47db5-2503-4391-8270-18c686b389d7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.895273 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fd47db5-2503-4391-8270-18c686b389d7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:16.898011 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fd47db5-2503-4391-8270-18c686b389d7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:16.906357 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fd47db5-2503-4391-8270-18c686b389d7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.921049 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a3e6dee1-8e78-405d-8aab-c3789d7f98a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.993306 Aug 31 00:21:16.922034 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:15 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:16.941752 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-653276fb-f842-4df0-aac2-d574d17e904d req-11806e90-d716-42e2-a3b9-41d4986b6a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d377dbb-6731-491e-bc79-3c63e6eb99a0", "tag": "7e5edb05-f5b5-4c24-a6ca-7eb658fb8ce2"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:16.963357 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-653276fb-f842-4df0-aac2-d574d17e904d req-11806e90-d716-42e2-a3b9-41d4986b6a19 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:16.964594 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-653276fb-f842-4df0-aac2-d574d17e904d req-11806e90-d716-42e2-a3b9-41d4986b6a19 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:16.965817 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-653276fb-f842-4df0-aac2-d574d17e904d req-11806e90-d716-42e2-a3b9-41d4986b6a19 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.015504 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-653276fb-f842-4df0-aac2-d574d17e904d req-11806e90-d716-42e2-a3b9-41d4986b6a19 service nova] Creating event network-changed:7e5edb05-f5b5-4c24-a6ca-7eb658fb8ce2 for instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 on hv-cinder-85221 Aug 31 00:21:17.031833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-653276fb-f842-4df0-aac2-d574d17e904d req-11806e90-d716-42e2-a3b9-41d4986b6a19 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104621 Aug 31 00:21:17.037517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 32/60] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:17.061195 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:17.076654 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:17.106474 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.110247 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.113855 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.116605 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.123262 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.124365 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.283392 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2fd47db5-2503-4391-8270-18c686b389d7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:17.301753 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2fd47db5-2503-4391-8270-18c686b389d7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1361 microversion: 2.1 time: 0.431302 Aug 31 00:21:17.319748 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 29/61] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:16 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1361 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:17.351602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-52f867fc-664e-43fd-ab37-3c096584db30 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:17.366839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-52f867fc-664e-43fd-ab37-3c096584db30 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:17.388080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-52f867fc-664e-43fd-ab37-3c096584db30 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.393138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-52f867fc-664e-43fd-ab37-3c096584db30 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.394974 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-52f867fc-664e-43fd-ab37-3c096584db30 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.398568 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-52f867fc-664e-43fd-ab37-3c096584db30 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.400752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-52f867fc-664e-43fd-ab37-3c096584db30 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.404328 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-52f867fc-664e-43fd-ab37-3c096584db30 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.856566 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:17.867146 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:17.868682 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:17.869841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5f3e3fd9-3cb5-47b0-b871-629695cfabc2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1406 microversion: 2.20 time: 0.823128 Aug 31 00:21:17.870612 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 33/62] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:17 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1406 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:17.901939 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-93171327-bd2d-4c21-8e71-dd5786d9c1f5 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:17.902996 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-93171327-bd2d-4c21-8e71-dd5786d9c1f5 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:17.909379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-93171327-bd2d-4c21-8e71-dd5786d9c1f5 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.909881 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-93171327-bd2d-4c21-8e71-dd5786d9c1f5 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.910320 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-93171327-bd2d-4c21-8e71-dd5786d9c1f5 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.911661 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-93171327-bd2d-4c21-8e71-dd5786d9c1f5 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.912170 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-93171327-bd2d-4c21-8e71-dd5786d9c1f5 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.913010 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-93171327-bd2d-4c21-8e71-dd5786d9c1f5 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.928530 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-52f867fc-664e-43fd-ab37-3c096584db30 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:17.949032 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-52f867fc-664e-43fd-ab37-3c096584db30 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1321 microversion: 2.1 time: 0.626920 Aug 31 00:21:17.949755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 30/63] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:17 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1321 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:17.955340 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-fa2fb93f-f5cd-4029-a84d-0c791fe8938c req-b9b5c7f9-12a0-4a84-a71f-1e8e97e96107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f274203-f40e-4cc4-b0c6-a181fb704311", "name": "network-vif-plugged", "status": "completed", "tag": "eadb7db5-44a8-41e0-ac9f-63b1573f5a39"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:17.966672 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-fa2fb93f-f5cd-4029-a84d-0c791fe8938c req-b9b5c7f9-12a0-4a84-a71f-1e8e97e96107 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.967846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-fa2fb93f-f5cd-4029-a84d-0c791fe8938c req-b9b5c7f9-12a0-4a84-a71f-1e8e97e96107 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.968475 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-fa2fb93f-f5cd-4029-a84d-0c791fe8938c req-b9b5c7f9-12a0-4a84-a71f-1e8e97e96107 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.994369 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-fa2fb93f-f5cd-4029-a84d-0c791fe8938c req-b9b5c7f9-12a0-4a84-a71f-1e8e97e96107 service nova] Creating event network-vif-plugged:eadb7db5-44a8-41e0-ac9f-63b1573f5a39 for instance 1f274203-f40e-4cc4-b0c6-a181fb704311 on hv-cinder-85221 Aug 31 00:21:18.026606 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-fa2fb93f-f5cd-4029-a84d-0c791fe8938c req-b9b5c7f9-12a0-4a84-a71f-1e8e97e96107 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074312 Aug 31 00:21:18.027586 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 31/64] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:18.036549 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f7a22c66-edba-4369-baf4-53f65697c6cf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:18.037378 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f7a22c66-edba-4369-baf4-53f65697c6cf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:18.045987 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f7a22c66-edba-4369-baf4-53f65697c6cf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.048556 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f7a22c66-edba-4369-baf4-53f65697c6cf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.050303 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f7a22c66-edba-4369-baf4-53f65697c6cf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.052481 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f7a22c66-edba-4369-baf4-53f65697c6cf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.053502 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f7a22c66-edba-4369-baf4-53f65697c6cf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.054555 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f7a22c66-edba-4369-baf4-53f65697c6cf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.178387 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-93171327-bd2d-4c21-8e71-dd5786d9c1f5 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.189102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-93171327-bd2d-4c21-8e71-dd5786d9c1f5 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1501 microversion: 2.1 time: 0.291132 Aug 31 00:21:18.190770 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 34/65] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:17 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:18.275310 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f7a22c66-edba-4369-baf4-53f65697c6cf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.286557 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f7a22c66-edba-4369-baf4-53f65697c6cf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.255977 Aug 31 00:21:18.287586 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 32/66] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:18 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:18.345260 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1cc4a5a0-6d6a-4027-bc6f-61301f1eeac5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:18.346368 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1cc4a5a0-6d6a-4027-bc6f-61301f1eeac5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:18.356355 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cc4a5a0-6d6a-4027-bc6f-61301f1eeac5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.357106 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cc4a5a0-6d6a-4027-bc6f-61301f1eeac5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.357732 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cc4a5a0-6d6a-4027-bc6f-61301f1eeac5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.358641 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cc4a5a0-6d6a-4027-bc6f-61301f1eeac5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.359109 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cc4a5a0-6d6a-4027-bc6f-61301f1eeac5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.359534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cc4a5a0-6d6a-4027-bc6f-61301f1eeac5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.917511 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:18.918448 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:18.930324 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.930952 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.931412 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.932220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.932701 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.937514 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.951362 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=100 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:19.179416 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1cc4a5a0-6d6a-4027-bc6f-61301f1eeac5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.193753 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1cc4a5a0-6d6a-4027-bc6f-61301f1eeac5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1361 microversion: 2.1 time: 0.856000 Aug 31 00:21:19.199511 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 35/67] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:18 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1361 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:19.209896 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ab72421a-027b-4e90-93ac-2004e7c79dbc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:19.217181 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ab72421a-027b-4e90-93ac-2004e7c79dbc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:19.234137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab72421a-027b-4e90-93ac-2004e7c79dbc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.239552 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab72421a-027b-4e90-93ac-2004e7c79dbc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.240277 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab72421a-027b-4e90-93ac-2004e7c79dbc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.241526 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab72421a-027b-4e90-93ac-2004e7c79dbc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.242163 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab72421a-027b-4e90-93ac-2004e7c79dbc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.243005 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab72421a-027b-4e90-93ac-2004e7c79dbc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.335361 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.346577 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.348388 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.351595 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c3eb9ede-329c-42b9-b312-e8baa7383e8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1406 microversion: 2.20 time: 0.438678 Aug 31 00:21:19.352457 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 33/68] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:18 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:19.357148 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-435526eb-8ed8-4520-8865-05e7450f9fb1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:19.358422 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-435526eb-8ed8-4520-8865-05e7450f9fb1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:19.365281 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-435526eb-8ed8-4520-8865-05e7450f9fb1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.366138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-435526eb-8ed8-4520-8865-05e7450f9fb1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.367395 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-435526eb-8ed8-4520-8865-05e7450f9fb1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.368550 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-435526eb-8ed8-4520-8865-05e7450f9fb1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.369507 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-435526eb-8ed8-4520-8865-05e7450f9fb1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.370257 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-435526eb-8ed8-4520-8865-05e7450f9fb1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.525751 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ab72421a-027b-4e90-93ac-2004e7c79dbc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.538555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ab72421a-027b-4e90-93ac-2004e7c79dbc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1321 microversion: 2.1 time: 0.337551 Aug 31 00:21:19.553039 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 36/69] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:19 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:19.592090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-435526eb-8ed8-4520-8865-05e7450f9fb1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.607134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-435526eb-8ed8-4520-8865-05e7450f9fb1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.253715 Aug 31 00:21:19.608415 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 34/70] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:19 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:20.046222 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-5e84111a-992c-4994-a5aa-70c86759c305 req-439d2084-24f2-4e77-af78-9176b20e6bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a312d8-6cb2-4da8-a19b-215372294799", "name": "network-vif-plugged", "status": "completed", "tag": "0ff0dbfa-0c17-4d1f-bc12-fdd58530b639"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:20.057679 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-5e84111a-992c-4994-a5aa-70c86759c305 req-439d2084-24f2-4e77-af78-9176b20e6bf7 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.058159 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-5e84111a-992c-4994-a5aa-70c86759c305 req-439d2084-24f2-4e77-af78-9176b20e6bf7 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.059046 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-5e84111a-992c-4994-a5aa-70c86759c305 req-439d2084-24f2-4e77-af78-9176b20e6bf7 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.073198 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-5e84111a-992c-4994-a5aa-70c86759c305 req-439d2084-24f2-4e77-af78-9176b20e6bf7 service nova] Creating event network-vif-plugged:0ff0dbfa-0c17-4d1f-bc12-fdd58530b639 for instance e3a312d8-6cb2-4da8-a19b-215372294799 on hv-cinder-85221 Aug 31 00:21:20.079084 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-5e84111a-992c-4994-a5aa-70c86759c305 req-439d2084-24f2-4e77-af78-9176b20e6bf7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037550 Aug 31 00:21:20.080110 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 37/71] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:20.223643 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-47abe6ad-54cb-4b61-a29b-e35d21f07188 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:20.225024 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-47abe6ad-54cb-4b61-a29b-e35d21f07188 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:20.243024 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6db2c6bf-0621-474f-bcc5-af9d00644244 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11db5787-497b-45b6-9ba3-cbaa6ca39d63"}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:20.247624 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6db2c6bf-0621-474f-bcc5-af9d00644244 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:20.250669 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47abe6ad-54cb-4b61-a29b-e35d21f07188 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.251358 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47abe6ad-54cb-4b61-a29b-e35d21f07188 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.251803 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47abe6ad-54cb-4b61-a29b-e35d21f07188 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.252581 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47abe6ad-54cb-4b61-a29b-e35d21f07188 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.253054 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47abe6ad-54cb-4b61-a29b-e35d21f07188 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.253577 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47abe6ad-54cb-4b61-a29b-e35d21f07188 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.262118 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6db2c6bf-0621-474f-bcc5-af9d00644244 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.263252 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6db2c6bf-0621-474f-bcc5-af9d00644244 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.263865 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6db2c6bf-0621-474f-bcc5-af9d00644244 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.265173 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6db2c6bf-0621-474f-bcc5-af9d00644244 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.265939 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6db2c6bf-0621-474f-bcc5-af9d00644244 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.266714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6db2c6bf-0621-474f-bcc5-af9d00644244 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.660213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-47abe6ad-54cb-4b61-a29b-e35d21f07188 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:20.669587 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-47abe6ad-54cb-4b61-a29b-e35d21f07188 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1546 microversion: 2.1 time: 0.454781 Aug 31 00:21:20.677797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 35/72] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:20 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1546 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:20.684770 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:20.685922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:20.694380 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.695144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.696032 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.697096 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.697795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.698615 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.918195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:20.930051 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:20.931584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:20.932929 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b9b01ca6-769a-4486-8bc2-1020544db363 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1406 microversion: 2.20 time: 0.253000 Aug 31 00:21:20.933426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 36/73] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:20 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:20.949390 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-12d15677-1ccb-435b-93d5-eed1a3ba535e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:20.951764 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-12d15677-1ccb-435b-93d5-eed1a3ba535e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:20.964974 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-12d15677-1ccb-435b-93d5-eed1a3ba535e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.965786 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-12d15677-1ccb-435b-93d5-eed1a3ba535e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.966502 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-12d15677-1ccb-435b-93d5-eed1a3ba535e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.967606 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-12d15677-1ccb-435b-93d5-eed1a3ba535e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.968379 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-12d15677-1ccb-435b-93d5-eed1a3ba535e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.969125 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-12d15677-1ccb-435b-93d5-eed1a3ba535e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.181743 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-12d15677-1ccb-435b-93d5-eed1a3ba535e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:21.190815 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-12d15677-1ccb-435b-93d5-eed1a3ba535e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1321 microversion: 2.1 time: 0.252870 Aug 31 00:21:21.192965 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 37/74] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:20 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:21.196973 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c75d915e-3a5e-4177-9cd8-994bbc5c17e0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:21.197739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c75d915e-3a5e-4177-9cd8-994bbc5c17e0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:21.205025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c75d915e-3a5e-4177-9cd8-994bbc5c17e0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.205668 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c75d915e-3a5e-4177-9cd8-994bbc5c17e0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.206195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c75d915e-3a5e-4177-9cd8-994bbc5c17e0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.207154 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c75d915e-3a5e-4177-9cd8-994bbc5c17e0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.207822 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c75d915e-3a5e-4177-9cd8-994bbc5c17e0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.209087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c75d915e-3a5e-4177-9cd8-994bbc5c17e0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.441010 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c75d915e-3a5e-4177-9cd8-994bbc5c17e0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:21.450342 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c75d915e-3a5e-4177-9cd8-994bbc5c17e0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.257788 Aug 31 00:21:21.450942 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 38/75] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:21 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:21.455870 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b38084fd-07cf-478e-bbf1-3dbeb9f55b6c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:21.456408 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b38084fd-07cf-478e-bbf1-3dbeb9f55b6c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:21.465029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b38084fd-07cf-478e-bbf1-3dbeb9f55b6c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.465529 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b38084fd-07cf-478e-bbf1-3dbeb9f55b6c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.465965 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b38084fd-07cf-478e-bbf1-3dbeb9f55b6c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.466774 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b38084fd-07cf-478e-bbf1-3dbeb9f55b6c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.467226 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b38084fd-07cf-478e-bbf1-3dbeb9f55b6c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.467659 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b38084fd-07cf-478e-bbf1-3dbeb9f55b6c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.598041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b38084fd-07cf-478e-bbf1-3dbeb9f55b6c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145991 Aug 31 00:21:21.599213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 39/76] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 31 00:21:21 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:21.973043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:21.974299 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:21.994513 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.995658 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.996737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.998249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.999265 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.000465 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.243361 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.260257 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.263747 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.265988 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f5dd8dd8-f176-4860-a79f-30292b135ded tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1406 microversion: 2.20 time: 0.303029 Aug 31 00:21:22.267077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 40/77] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:21 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:22.279432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d5e6da29-ee98-4c4b-a427-ee3b01f1f733 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:22.280889 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d5e6da29-ee98-4c4b-a427-ee3b01f1f733 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:22.293287 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5e6da29-ee98-4c4b-a427-ee3b01f1f733 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.294168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5e6da29-ee98-4c4b-a427-ee3b01f1f733 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.294974 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5e6da29-ee98-4c4b-a427-ee3b01f1f733 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.296336 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5e6da29-ee98-4c4b-a427-ee3b01f1f733 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.297447 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5e6da29-ee98-4c4b-a427-ee3b01f1f733 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.298434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5e6da29-ee98-4c4b-a427-ee3b01f1f733 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.789367 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d5e6da29-ee98-4c4b-a427-ee3b01f1f733 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.815562 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d5e6da29-ee98-4c4b-a427-ee3b01f1f733 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1321 microversion: 2.1 time: 0.546332 Aug 31 00:21:22.833651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 41/78] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:22 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1321 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:22.844458 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-75945989-caa0-42c7-af88-d4196c1c52c7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:22.845996 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-75945989-caa0-42c7-af88-d4196c1c52c7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:22.860666 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75945989-caa0-42c7-af88-d4196c1c52c7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.861484 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75945989-caa0-42c7-af88-d4196c1c52c7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.864718 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75945989-caa0-42c7-af88-d4196c1c52c7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.866444 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75945989-caa0-42c7-af88-d4196c1c52c7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.867750 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75945989-caa0-42c7-af88-d4196c1c52c7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.868795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75945989-caa0-42c7-af88-d4196c1c52c7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.155602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-75945989-caa0-42c7-af88-d4196c1c52c7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.165394 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-75945989-caa0-42c7-af88-d4196c1c52c7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.329507 Aug 31 00:21:23.166347 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 42/79] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:22 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:23.171440 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-beab5c46-35aa-418d-aa85-41b7a67a367a req-4c327fc4-2a8f-47c9-b972-5b66c106b440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379d25b6-01b5-4bed-ba25-2f169d66600b", "name": "network-vif-plugged", "status": "completed", "tag": "b667fe99-0903-42b3-8838-53300f0a504b"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:23.186784 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-beab5c46-35aa-418d-aa85-41b7a67a367a req-4c327fc4-2a8f-47c9-b972-5b66c106b440 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.187314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-beab5c46-35aa-418d-aa85-41b7a67a367a req-4c327fc4-2a8f-47c9-b972-5b66c106b440 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.187838 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-beab5c46-35aa-418d-aa85-41b7a67a367a req-4c327fc4-2a8f-47c9-b972-5b66c106b440 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.203437 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-beab5c46-35aa-418d-aa85-41b7a67a367a req-4c327fc4-2a8f-47c9-b972-5b66c106b440 service nova] Creating event network-vif-plugged:b667fe99-0903-42b3-8838-53300f0a504b for instance 379d25b6-01b5-4bed-ba25-2f169d66600b on hv-cinder-85221 Aug 31 00:21:23.209883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-beab5c46-35aa-418d-aa85-41b7a67a367a req-4c327fc4-2a8f-47c9-b972-5b66c106b440 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042137 Aug 31 00:21:23.210501 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 43/80] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:23.294695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:23.296501 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:23.306640 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.307619 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.308290 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.309220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.309846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.310624 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.689819 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6db2c6bf-0621-474f-bcc5-af9d00644244 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "POST /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.460541 Aug 31 00:21:23.709102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 38/81] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:21:20 2022] POST /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1/os-volume_attachments => generated 194 bytes in 3482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:23.855175 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c368a1b7-2c2d-404d-bd34-b043fac4122c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:23.856550 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c368a1b7-2c2d-404d-bd34-b043fac4122c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:23.861720 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:23.880838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c368a1b7-2c2d-404d-bd34-b043fac4122c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.882705 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c368a1b7-2c2d-404d-bd34-b043fac4122c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.883522 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c368a1b7-2c2d-404d-bd34-b043fac4122c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.885102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c368a1b7-2c2d-404d-bd34-b043fac4122c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.885919 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c368a1b7-2c2d-404d-bd34-b043fac4122c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.886476 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c368a1b7-2c2d-404d-bd34-b043fac4122c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.902509 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.916896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.919216 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.921877 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ff3cc913-3dae-4fd2-b4e4-b662330cec6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1597 microversion: 2.20 time: 0.632904 Aug 31 00:21:23.922807 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 44/82] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:23 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1597 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:23.969807 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-077f487f-f018-4b89-b492-31d8c3b573a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:23.970306 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-077f487f-f018-4b89-b492-31d8c3b573a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:23.993139 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-077f487f-f018-4b89-b492-31d8c3b573a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.995051 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-077f487f-f018-4b89-b492-31d8c3b573a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.995841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-077f487f-f018-4b89-b492-31d8c3b573a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.996895 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-077f487f-f018-4b89-b492-31d8c3b573a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.997635 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-077f487f-f018-4b89-b492-31d8c3b573a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.998335 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-077f487f-f018-4b89-b492-31d8c3b573a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:24.316914 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-077f487f-f018-4b89-b492-31d8c3b573a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.351277 Aug 31 00:21:24.318208 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 45/83] 10.222.0.47 () {60 vars in 1316 bytes} [Wed Aug 31 00:21:23 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-interface => generated 284 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:21:24.323957 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7fba8e9a-f368-4c94-a98f-f2bd95f8b31c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:24.325099 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7fba8e9a-f368-4c94-a98f-f2bd95f8b31c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:24.355854 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7fba8e9a-f368-4c94-a98f-f2bd95f8b31c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:24.357334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7fba8e9a-f368-4c94-a98f-f2bd95f8b31c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:24.366588 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7fba8e9a-f368-4c94-a98f-f2bd95f8b31c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:24.370602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7fba8e9a-f368-4c94-a98f-f2bd95f8b31c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:24.371559 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7fba8e9a-f368-4c94-a98f-f2bd95f8b31c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:24.372250 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7fba8e9a-f368-4c94-a98f-f2bd95f8b31c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.157680 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c368a1b7-2c2d-404d-bd34-b043fac4122c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:25.187168 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c368a1b7-2c2d-404d-bd34-b043fac4122c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1514 microversion: 2.1 time: 1.338658 Aug 31 00:21:25.188093 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 39/84] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:23 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1514 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:25.231610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-2c5788fb-67e7-4072-9e56-caf15505fd4f req-9807473a-34cb-4e70-9d33-cc30a63adc6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e22ddf8-4065-4933-a8db-68b53f82a42e", "tag": "6317fbd6-92fd-41d8-a8a9-21faad23ff44"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:25.252497 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-2c5788fb-67e7-4072-9e56-caf15505fd4f req-9807473a-34cb-4e70-9d33-cc30a63adc6c service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.253654 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-2c5788fb-67e7-4072-9e56-caf15505fd4f req-9807473a-34cb-4e70-9d33-cc30a63adc6c service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.255569 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-2c5788fb-67e7-4072-9e56-caf15505fd4f req-9807473a-34cb-4e70-9d33-cc30a63adc6c service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.322555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-2c5788fb-67e7-4072-9e56-caf15505fd4f req-9807473a-34cb-4e70-9d33-cc30a63adc6c service nova] Creating event network-changed:6317fbd6-92fd-41d8-a8a9-21faad23ff44 for instance 1e22ddf8-4065-4933-a8db-68b53f82a42e on hv-cinder-85221 Aug 31 00:21:25.345877 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-2c5788fb-67e7-4072-9e56-caf15505fd4f req-9807473a-34cb-4e70-9d33-cc30a63adc6c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133505 Aug 31 00:21:25.346655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 40/85] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:25.383715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d4233d47-dc0c-4f17-86e6-958733854d01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:25.394236 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d4233d47-dc0c-4f17-86e6-958733854d01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:25.422231 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4233d47-dc0c-4f17-86e6-958733854d01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.423257 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4233d47-dc0c-4f17-86e6-958733854d01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.424068 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4233d47-dc0c-4f17-86e6-958733854d01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.425381 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4233d47-dc0c-4f17-86e6-958733854d01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.433940 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4233d47-dc0c-4f17-86e6-958733854d01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.435140 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4233d47-dc0c-4f17-86e6-958733854d01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.550804 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-d4233d47-dc0c-4f17-86e6-958733854d01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lazy-loading 'flavor' on Instance uuid 1f274203-f40e-4cc4-b0c6-a181fb704311 {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:21:25.647612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7fba8e9a-f368-4c94-a98f-f2bd95f8b31c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:25.685122 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7fba8e9a-f368-4c94-a98f-f2bd95f8b31c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 1.356502 Aug 31 00:21:25.686988 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 46/86] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:24 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:25.919200 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:26.061128 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d4233d47-dc0c-4f17-86e6-958733854d01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "POST /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311/action" status: 200 len: 32 microversion: 2.1 time: 0.708277 Aug 31 00:21:26.062588 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 41/87] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:21:25 2022] POST /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311/action => generated 32 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:21:26.075831 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-36117a07-1783-4531-b677-acfc07caf03c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:26.076937 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-36117a07-1783-4531-b677-acfc07caf03c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:26.090128 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-36117a07-1783-4531-b677-acfc07caf03c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.090648 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-36117a07-1783-4531-b677-acfc07caf03c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.091101 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-36117a07-1783-4531-b677-acfc07caf03c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.091849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-36117a07-1783-4531-b677-acfc07caf03c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.092363 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-36117a07-1783-4531-b677-acfc07caf03c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.092790 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-36117a07-1783-4531-b677-acfc07caf03c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.560116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-36117a07-1783-4531-b677-acfc07caf03c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:26.583958 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-36117a07-1783-4531-b677-acfc07caf03c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.512047 Aug 31 00:21:26.594015 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 47/88] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:26 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:26.731258 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ce649328-d150-4238-b89b-dbbcc9ed429e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:26.733775 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ce649328-d150-4238-b89b-dbbcc9ed429e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:26.766073 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce649328-d150-4238-b89b-dbbcc9ed429e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.767597 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce649328-d150-4238-b89b-dbbcc9ed429e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.769673 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce649328-d150-4238-b89b-dbbcc9ed429e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.775810 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce649328-d150-4238-b89b-dbbcc9ed429e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.778314 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce649328-d150-4238-b89b-dbbcc9ed429e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.779313 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce649328-d150-4238-b89b-dbbcc9ed429e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.388185 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-19487ccb-47df-421e-b5ef-6279aad19e0c req-a644ead2-835d-4897-8c25-b8a68f925071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a312d8-6cb2-4da8-a19b-215372294799", "tag": "0ff0dbfa-0c17-4d1f-bc12-fdd58530b639"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:27.402523 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ce649328-d150-4238-b89b-dbbcc9ed429e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:27.447594 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ce649328-d150-4238-b89b-dbbcc9ed429e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.721588 Aug 31 00:21:27.449300 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 42/89] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:26 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:27.449680 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-19487ccb-47df-421e-b5ef-6279aad19e0c req-a644ead2-835d-4897-8c25-b8a68f925071 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.451771 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-19487ccb-47df-421e-b5ef-6279aad19e0c req-a644ead2-835d-4897-8c25-b8a68f925071 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.452878 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-19487ccb-47df-421e-b5ef-6279aad19e0c req-a644ead2-835d-4897-8c25-b8a68f925071 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.479400 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-19487ccb-47df-421e-b5ef-6279aad19e0c req-a644ead2-835d-4897-8c25-b8a68f925071 service nova] Creating event network-changed:0ff0dbfa-0c17-4d1f-bc12-fdd58530b639 for instance e3a312d8-6cb2-4da8-a19b-215372294799 on hv-cinder-85221 Aug 31 00:21:27.490572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-19487ccb-47df-421e-b5ef-6279aad19e0c req-a644ead2-835d-4897-8c25-b8a68f925071 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115568 Aug 31 00:21:27.492587 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 48/90] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:27.642165 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-640416d9-7b88-4c53-a68a-14ea218f366b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:27.643484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-640416d9-7b88-4c53-a68a-14ea218f366b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:27.679568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-640416d9-7b88-4c53-a68a-14ea218f366b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.681483 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-640416d9-7b88-4c53-a68a-14ea218f366b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.683282 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-640416d9-7b88-4c53-a68a-14ea218f366b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.685571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-640416d9-7b88-4c53-a68a-14ea218f366b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.686640 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-640416d9-7b88-4c53-a68a-14ea218f366b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.688334 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-640416d9-7b88-4c53-a68a-14ea218f366b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.137554 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-640416d9-7b88-4c53-a68a-14ea218f366b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:28.198403 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-640416d9-7b88-4c53-a68a-14ea218f366b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.568696 Aug 31 00:21:28.201361 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 43/91] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:27 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:28.503741 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c61f97e4-e320-4f6f-815b-b78bb2df90ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:28.505179 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c61f97e4-e320-4f6f-815b-b78bb2df90ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:28.518263 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c61f97e4-e320-4f6f-815b-b78bb2df90ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.518767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c61f97e4-e320-4f6f-815b-b78bb2df90ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.519204 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c61f97e4-e320-4f6f-815b-b78bb2df90ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.519933 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c61f97e4-e320-4f6f-815b-b78bb2df90ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.521779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c61f97e4-e320-4f6f-815b-b78bb2df90ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.521925 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c61f97e4-e320-4f6f-815b-b78bb2df90ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.781406 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c61f97e4-e320-4f6f-815b-b78bb2df90ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:28.802907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c61f97e4-e320-4f6f-815b-b78bb2df90ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.304110 Aug 31 00:21:28.818469 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 49/92] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:28 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:29.231860 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9f9b9eb5-bcf4-40eb-bd97-8c19d1a7ddc0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:29.234852 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9f9b9eb5-bcf4-40eb-bd97-8c19d1a7ddc0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:29.256076 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f9b9eb5-bcf4-40eb-bd97-8c19d1a7ddc0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.257389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f9b9eb5-bcf4-40eb-bd97-8c19d1a7ddc0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.258058 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f9b9eb5-bcf4-40eb-bd97-8c19d1a7ddc0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.259596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f9b9eb5-bcf4-40eb-bd97-8c19d1a7ddc0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.260375 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f9b9eb5-bcf4-40eb-bd97-8c19d1a7ddc0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.261301 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f9b9eb5-bcf4-40eb-bd97-8c19d1a7ddc0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.829706 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f83e4ce2-acc4-4d55-8e9d-1f6693dd2278 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:29.830464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f83e4ce2-acc4-4d55-8e9d-1f6693dd2278 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:29.845800 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f83e4ce2-acc4-4d55-8e9d-1f6693dd2278 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.846312 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f83e4ce2-acc4-4d55-8e9d-1f6693dd2278 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.846743 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f83e4ce2-acc4-4d55-8e9d-1f6693dd2278 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.847486 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f83e4ce2-acc4-4d55-8e9d-1f6693dd2278 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.850041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f83e4ce2-acc4-4d55-8e9d-1f6693dd2278 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.850853 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f83e4ce2-acc4-4d55-8e9d-1f6693dd2278 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:30.184461 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9f9b9eb5-bcf4-40eb-bd97-8c19d1a7ddc0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:30.219730 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9f9b9eb5-bcf4-40eb-bd97-8c19d1a7ddc0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.996256 Aug 31 00:21:30.220976 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 44/93] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:29 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:30.900548 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f83e4ce2-acc4-4d55-8e9d-1f6693dd2278 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:30.931867 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f83e4ce2-acc4-4d55-8e9d-1f6693dd2278 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 1.108021 Aug 31 00:21:30.932640 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 50/94] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:29 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:31.258545 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7fc885ae-043d-4d74-9e36-c84f64d5abcd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:31.259720 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7fc885ae-043d-4d74-9e36-c84f64d5abcd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:31.278062 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fc885ae-043d-4d74-9e36-c84f64d5abcd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.279764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fc885ae-043d-4d74-9e36-c84f64d5abcd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.280868 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fc885ae-043d-4d74-9e36-c84f64d5abcd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.282272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fc885ae-043d-4d74-9e36-c84f64d5abcd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.283505 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fc885ae-043d-4d74-9e36-c84f64d5abcd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.284372 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fc885ae-043d-4d74-9e36-c84f64d5abcd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.535225 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7fc885ae-043d-4d74-9e36-c84f64d5abcd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.549001 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7fc885ae-043d-4d74-9e36-c84f64d5abcd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.300188 Aug 31 00:21:31.563411 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 45/95] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:31 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:31.604035 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-3298f4f6-9b41-4a35-bb8f-902d550f5a8b req-42556b0d-c28e-48e0-bd2b-8b748e8ace23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d377dbb-6731-491e-bc79-3c63e6eb99a0", "name": "network-vif-plugged", "status": "completed", "tag": "7e5edb05-f5b5-4c24-a6ca-7eb658fb8ce2"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:31.633895 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=72 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:31.659121 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3298f4f6-9b41-4a35-bb8f-902d550f5a8b req-42556b0d-c28e-48e0-bd2b-8b748e8ace23 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.659886 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3298f4f6-9b41-4a35-bb8f-902d550f5a8b req-42556b0d-c28e-48e0-bd2b-8b748e8ace23 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.667356 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3298f4f6-9b41-4a35-bb8f-902d550f5a8b req-42556b0d-c28e-48e0-bd2b-8b748e8ace23 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.706954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-3298f4f6-9b41-4a35-bb8f-902d550f5a8b req-42556b0d-c28e-48e0-bd2b-8b748e8ace23 service nova] Creating event network-vif-plugged:7e5edb05-f5b5-4c24-a6ca-7eb658fb8ce2 for instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 on hv-cinder-85221 Aug 31 00:21:31.717813 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-3298f4f6-9b41-4a35-bb8f-902d550f5a8b req-42556b0d-c28e-48e0-bd2b-8b748e8ace23 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124422 Aug 31 00:21:31.719430 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 51/96] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:31.959712 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-fd5254d9-182f-4b0e-a6b4-0a72e06fe129 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:31.961358 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-fd5254d9-182f-4b0e-a6b4-0a72e06fe129 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:31.970232 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fd5254d9-182f-4b0e-a6b4-0a72e06fe129 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.971125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fd5254d9-182f-4b0e-a6b4-0a72e06fe129 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.971877 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fd5254d9-182f-4b0e-a6b4-0a72e06fe129 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.974049 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fd5254d9-182f-4b0e-a6b4-0a72e06fe129 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.974783 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fd5254d9-182f-4b0e-a6b4-0a72e06fe129 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.975429 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fd5254d9-182f-4b0e-a6b4-0a72e06fe129 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.214137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-fd5254d9-182f-4b0e-a6b4-0a72e06fe129 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:32.230346 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-fd5254d9-182f-4b0e-a6b4-0a72e06fe129 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.277672 Aug 31 00:21:32.231123 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 46/97] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:31 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:32.576275 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-dc5fb43c-3d1e-4a9e-bb96-7abf8189a855 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:32.577663 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-dc5fb43c-3d1e-4a9e-bb96-7abf8189a855 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:32.588868 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc5fb43c-3d1e-4a9e-bb96-7abf8189a855 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.591579 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc5fb43c-3d1e-4a9e-bb96-7abf8189a855 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.592434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc5fb43c-3d1e-4a9e-bb96-7abf8189a855 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.593808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc5fb43c-3d1e-4a9e-bb96-7abf8189a855 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.594862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc5fb43c-3d1e-4a9e-bb96-7abf8189a855 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.595695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc5fb43c-3d1e-4a9e-bb96-7abf8189a855 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.617140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=100 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:32.790532 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-dc5fb43c-3d1e-4a9e-bb96-7abf8189a855 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:32.805420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-dc5fb43c-3d1e-4a9e-bb96-7abf8189a855 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.237179 Aug 31 00:21:32.806433 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 52/98] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:32 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:33.267112 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cfd1dcbc-b09e-4971-952c-36db13d48a41 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:33.268434 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-cfd1dcbc-b09e-4971-952c-36db13d48a41 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:33.276611 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfd1dcbc-b09e-4971-952c-36db13d48a41 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.277485 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfd1dcbc-b09e-4971-952c-36db13d48a41 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.277929 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfd1dcbc-b09e-4971-952c-36db13d48a41 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.278653 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfd1dcbc-b09e-4971-952c-36db13d48a41 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.279109 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfd1dcbc-b09e-4971-952c-36db13d48a41 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.279528 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfd1dcbc-b09e-4971-952c-36db13d48a41 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.548476 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cfd1dcbc-b09e-4971-952c-36db13d48a41 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:33.561700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cfd1dcbc-b09e-4971-952c-36db13d48a41 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.297094 Aug 31 00:21:33.563739 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 47/99] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:33 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:33.834711 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ce6022e1-0953-4aee-ae16-6c8ddea28cf4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:33.836233 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ce6022e1-0953-4aee-ae16-6c8ddea28cf4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:33.848990 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce6022e1-0953-4aee-ae16-6c8ddea28cf4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.850023 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce6022e1-0953-4aee-ae16-6c8ddea28cf4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.850787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce6022e1-0953-4aee-ae16-6c8ddea28cf4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.852359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce6022e1-0953-4aee-ae16-6c8ddea28cf4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.862032 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce6022e1-0953-4aee-ae16-6c8ddea28cf4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.862867 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce6022e1-0953-4aee-ae16-6c8ddea28cf4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.444730 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ce6022e1-0953-4aee-ae16-6c8ddea28cf4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.465715 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ce6022e1-0953-4aee-ae16-6c8ddea28cf4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.641314 Aug 31 00:21:34.466955 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 53/100] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:33 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:34.481327 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6fed0336-bebc-4187-bce3-ba65ea73eeac tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:34.482315 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6fed0336-bebc-4187-bce3-ba65ea73eeac tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.492584 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6fed0336-bebc-4187-bce3-ba65ea73eeac tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.493106 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6fed0336-bebc-4187-bce3-ba65ea73eeac tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.493539 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6fed0336-bebc-4187-bce3-ba65ea73eeac tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.494254 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6fed0336-bebc-4187-bce3-ba65ea73eeac tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.494858 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6fed0336-bebc-4187-bce3-ba65ea73eeac tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.495284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6fed0336-bebc-4187-bce3-ba65ea73eeac tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.565044 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6fed0336-bebc-4187-bce3-ba65ea73eeac tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:21:34.613488 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1b10a1e0-301f-43c2-9f81-3b547df4ef42 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:34.615873 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1b10a1e0-301f-43c2-9f81-3b547df4ef42 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.627298 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1b10a1e0-301f-43c2-9f81-3b547df4ef42 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.628514 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1b10a1e0-301f-43c2-9f81-3b547df4ef42 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.629642 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1b10a1e0-301f-43c2-9f81-3b547df4ef42 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.631144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1b10a1e0-301f-43c2-9f81-3b547df4ef42 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.631972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1b10a1e0-301f-43c2-9f81-3b547df4ef42 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.636034 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1b10a1e0-301f-43c2-9f81-3b547df4ef42 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.705389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6fed0336-bebc-4187-bce3-ba65ea73eeac tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 204 len: 0 microversion: 2.1 time: 0.234254 Aug 31 00:21:34.706270 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 48/101] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:21:34 2022] DELETE /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:21:34.717255 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-762e3c89-1cba-41a8-96be-e6439982958c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:34.718200 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-762e3c89-1cba-41a8-96be-e6439982958c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.728013 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-762e3c89-1cba-41a8-96be-e6439982958c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.728906 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-762e3c89-1cba-41a8-96be-e6439982958c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.729654 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-762e3c89-1cba-41a8-96be-e6439982958c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.730408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-762e3c89-1cba-41a8-96be-e6439982958c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.731193 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-762e3c89-1cba-41a8-96be-e6439982958c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.732033 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-762e3c89-1cba-41a8-96be-e6439982958c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.197911 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-762e3c89-1cba-41a8-96be-e6439982958c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.216209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1b10a1e0-301f-43c2-9f81-3b547df4ef42 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.224973 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-762e3c89-1cba-41a8-96be-e6439982958c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1553 microversion: 2.1 time: 0.511436 Aug 31 00:21:35.231524 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1b10a1e0-301f-43c2-9f81-3b547df4ef42 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.624722 Aug 31 00:21:35.252193 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 49/102] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:34 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1553 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:35.254762 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 54/103] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:34 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:35.487578 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-498dc0db-cfda-41a1-8b28-b148119d510d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:35.488466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-498dc0db-cfda-41a1-8b28-b148119d510d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:35.501829 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-498dc0db-cfda-41a1-8b28-b148119d510d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.502378 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-498dc0db-cfda-41a1-8b28-b148119d510d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.502843 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-498dc0db-cfda-41a1-8b28-b148119d510d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.503607 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-498dc0db-cfda-41a1-8b28-b148119d510d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.504069 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-498dc0db-cfda-41a1-8b28-b148119d510d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.505317 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-498dc0db-cfda-41a1-8b28-b148119d510d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.803213 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-498dc0db-cfda-41a1-8b28-b148119d510d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.819415 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-498dc0db-cfda-41a1-8b28-b148119d510d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.335295 Aug 31 00:21:35.820502 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 50/104] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:35 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:36.312401 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c17ec800-6001-46bb-8648-dfdd4f7c6f84 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:36.314680 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-80e1a2aa-7c57-488f-a3e3-c1d5985746c9 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:36.316106 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c17ec800-6001-46bb-8648-dfdd4f7c6f84 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:36.322474 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-80e1a2aa-7c57-488f-a3e3-c1d5985746c9 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:36.342367 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c17ec800-6001-46bb-8648-dfdd4f7c6f84 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.343839 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c17ec800-6001-46bb-8648-dfdd4f7c6f84 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.346163 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c17ec800-6001-46bb-8648-dfdd4f7c6f84 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.346356 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80e1a2aa-7c57-488f-a3e3-c1d5985746c9 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.347170 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80e1a2aa-7c57-488f-a3e3-c1d5985746c9 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.348901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c17ec800-6001-46bb-8648-dfdd4f7c6f84 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.349103 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80e1a2aa-7c57-488f-a3e3-c1d5985746c9 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.350576 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c17ec800-6001-46bb-8648-dfdd4f7c6f84 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.352234 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80e1a2aa-7c57-488f-a3e3-c1d5985746c9 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.352746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80e1a2aa-7c57-488f-a3e3-c1d5985746c9 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.353179 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80e1a2aa-7c57-488f-a3e3-c1d5985746c9 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.353739 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c17ec800-6001-46bb-8648-dfdd4f7c6f84 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.756008 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-80e1a2aa-7c57-488f-a3e3-c1d5985746c9 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:36.774491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-80e1a2aa-7c57-488f-a3e3-c1d5985746c9 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1553 microversion: 2.1 time: 0.488790 Aug 31 00:21:36.775494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 55/105] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:36 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1553 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:36.779811 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c17ec800-6001-46bb-8648-dfdd4f7c6f84 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:36.798078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c17ec800-6001-46bb-8648-dfdd4f7c6f84 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.502905 Aug 31 00:21:36.799727 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 51/106] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:36 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:36.845870 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1e83e1ed-76d2-47f6-90ec-971e4885664d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:36.846619 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1e83e1ed-76d2-47f6-90ec-971e4885664d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:36.855932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e83e1ed-76d2-47f6-90ec-971e4885664d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.856809 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e83e1ed-76d2-47f6-90ec-971e4885664d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.857466 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e83e1ed-76d2-47f6-90ec-971e4885664d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.858451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e83e1ed-76d2-47f6-90ec-971e4885664d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.859058 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e83e1ed-76d2-47f6-90ec-971e4885664d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.860003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e83e1ed-76d2-47f6-90ec-971e4885664d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.127023 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1e83e1ed-76d2-47f6-90ec-971e4885664d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:37.137439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1e83e1ed-76d2-47f6-90ec-971e4885664d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.296121 Aug 31 00:21:37.139142 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 56/107] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:36 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:37.814314 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5d576dc8-7e7c-460a-9d92-6d777e34be6f tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:37.816522 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5d576dc8-7e7c-460a-9d92-6d777e34be6f tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:37.828947 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-88165544-1c16-489e-9879-893042c5d802 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:37.829718 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-88165544-1c16-489e-9879-893042c5d802 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:37.830831 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d576dc8-7e7c-460a-9d92-6d777e34be6f tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.831719 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d576dc8-7e7c-460a-9d92-6d777e34be6f tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.833686 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d576dc8-7e7c-460a-9d92-6d777e34be6f tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.835373 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d576dc8-7e7c-460a-9d92-6d777e34be6f tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.836559 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d576dc8-7e7c-460a-9d92-6d777e34be6f tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.837653 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d576dc8-7e7c-460a-9d92-6d777e34be6f tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.857467 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88165544-1c16-489e-9879-893042c5d802 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.858300 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88165544-1c16-489e-9879-893042c5d802 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.859193 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88165544-1c16-489e-9879-893042c5d802 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.866424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88165544-1c16-489e-9879-893042c5d802 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.866424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88165544-1c16-489e-9879-893042c5d802 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.866424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88165544-1c16-489e-9879-893042c5d802 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.406354 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-88165544-1c16-489e-9879-893042c5d802 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.422835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-88165544-1c16-489e-9879-893042c5d802 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1366 microversion: 2.1 time: 0.600476 Aug 31 00:21:38.436969 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 57/108] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:37 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:38.458243 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5d576dc8-7e7c-460a-9d92-6d777e34be6f tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.464816 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-aab102e2-e42a-46dd-9f0a-ec0582308f5c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:38.466097 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-aab102e2-e42a-46dd-9f0a-ec0582308f5c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:38.478492 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-aab102e2-e42a-46dd-9f0a-ec0582308f5c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.479271 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-aab102e2-e42a-46dd-9f0a-ec0582308f5c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.479418 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5d576dc8-7e7c-460a-9d92-6d777e34be6f tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1553 microversion: 2.1 time: 0.672259 Aug 31 00:21:38.480060 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-aab102e2-e42a-46dd-9f0a-ec0582308f5c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.483936 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 52/109] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:37 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1553 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:38.484223 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-aab102e2-e42a-46dd-9f0a-ec0582308f5c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.484223 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-aab102e2-e42a-46dd-9f0a-ec0582308f5c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.484223 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-aab102e2-e42a-46dd-9f0a-ec0582308f5c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.690922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-aab102e2-e42a-46dd-9f0a-ec0582308f5c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.702912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-aab102e2-e42a-46dd-9f0a-ec0582308f5c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.264194 Aug 31 00:21:38.704537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 58/110] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:38 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:39.460342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8be1acd6-ab8a-4fe6-8dab-840e07750f8c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:39.460948 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8be1acd6-ab8a-4fe6-8dab-840e07750f8c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:39.469335 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8be1acd6-ab8a-4fe6-8dab-840e07750f8c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.469335 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8be1acd6-ab8a-4fe6-8dab-840e07750f8c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.469335 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8be1acd6-ab8a-4fe6-8dab-840e07750f8c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.469929 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8be1acd6-ab8a-4fe6-8dab-840e07750f8c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.470628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8be1acd6-ab8a-4fe6-8dab-840e07750f8c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.471850 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8be1acd6-ab8a-4fe6-8dab-840e07750f8c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.501651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7654dd48-9678-44da-83d3-3a70bed668d4 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:39.503780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7654dd48-9678-44da-83d3-3a70bed668d4 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:39.514896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7654dd48-9678-44da-83d3-3a70bed668d4 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.515727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7654dd48-9678-44da-83d3-3a70bed668d4 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.520485 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7654dd48-9678-44da-83d3-3a70bed668d4 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.521591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7654dd48-9678-44da-83d3-3a70bed668d4 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.522134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7654dd48-9678-44da-83d3-3a70bed668d4 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.523263 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7654dd48-9678-44da-83d3-3a70bed668d4 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.203764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8be1acd6-ab8a-4fe6-8dab-840e07750f8c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:40.210304 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7654dd48-9678-44da-83d3-3a70bed668d4 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:40.222637 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8be1acd6-ab8a-4fe6-8dab-840e07750f8c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1557 microversion: 2.1 time: 0.766246 Aug 31 00:21:40.234493 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 53/111] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:39 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1557 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:40.234693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7654dd48-9678-44da-83d3-3a70bed668d4 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1553 microversion: 2.1 time: 0.735731 Aug 31 00:21:40.234693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 59/112] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:39 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1553 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:40.250215 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-e1a35015-6826-4f21-b6a2-126222ada87e req-05a606a7-1c34-45b3-a76a-e9b630ba4cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfccff9c-84bb-4098-b492-f54f05b3ebd1", "name": "network-vif-deleted", "tag": "f1fa86d4-e574-414e-9f10-7f6572bb99f0"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:40.250428 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-be29ef33-2d74-4649-afef-62cbfae745dc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:40.251827 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-be29ef33-2d74-4649-afef-62cbfae745dc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:40.265839 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be29ef33-2d74-4649-afef-62cbfae745dc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.267640 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-e1a35015-6826-4f21-b6a2-126222ada87e req-05a606a7-1c34-45b3-a76a-e9b630ba4cf5 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.267857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be29ef33-2d74-4649-afef-62cbfae745dc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.268449 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-e1a35015-6826-4f21-b6a2-126222ada87e req-05a606a7-1c34-45b3-a76a-e9b630ba4cf5 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.268642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be29ef33-2d74-4649-afef-62cbfae745dc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.269094 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-e1a35015-6826-4f21-b6a2-126222ada87e req-05a606a7-1c34-45b3-a76a-e9b630ba4cf5 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.270920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be29ef33-2d74-4649-afef-62cbfae745dc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.271786 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be29ef33-2d74-4649-afef-62cbfae745dc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.272639 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be29ef33-2d74-4649-afef-62cbfae745dc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.286849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-e1a35015-6826-4f21-b6a2-126222ada87e req-05a606a7-1c34-45b3-a76a-e9b630ba4cf5 service nova] Creating event network-vif-deleted:f1fa86d4-e574-414e-9f10-7f6572bb99f0 for instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 on hv-cinder-85221 Aug 31 00:21:40.294622 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-e1a35015-6826-4f21-b6a2-126222ada87e req-05a606a7-1c34-45b3-a76a-e9b630ba4cf5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058516 Aug 31 00:21:40.297405 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 60/113] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:40.309293 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3d94fbd6-afec-4a07-90f6-8fe18a8e3840 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:40.310927 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3d94fbd6-afec-4a07-90f6-8fe18a8e3840 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:40.323531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3d94fbd6-afec-4a07-90f6-8fe18a8e3840 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.330935 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3d94fbd6-afec-4a07-90f6-8fe18a8e3840 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.333095 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3d94fbd6-afec-4a07-90f6-8fe18a8e3840 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.334664 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3d94fbd6-afec-4a07-90f6-8fe18a8e3840 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.336385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3d94fbd6-afec-4a07-90f6-8fe18a8e3840 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.337937 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3d94fbd6-afec-4a07-90f6-8fe18a8e3840 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.496037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3d94fbd6-afec-4a07-90f6-8fe18a8e3840 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.195969 Aug 31 00:21:40.497630 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 61/114] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 31 00:21:40 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:40.570889 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-be29ef33-2d74-4649-afef-62cbfae745dc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:40.590148 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-be29ef33-2d74-4649-afef-62cbfae745dc tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.363005 Aug 31 00:21:40.591444 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 54/115] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:40 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:41.278527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:41.282804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:41.299634 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.300283 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.300953 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.302498 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.303246 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.303866 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.366101 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.367027 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.367659 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.368288 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lazy-loading 'fault' on Instance uuid bfccff9c-84bb-4098-b492-f54f05b3ebd1 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:21:41.430598 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae7c3709577481b8661ccd80369bd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3406349e71d4d96bd33248ce77d5066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:41.445186 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-835736b0-7368-4159-9416-bfb0886dcb5d tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 200 len: 1350 microversion: 2.1 time: 0.179236 Aug 31 00:21:41.446773 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 62/116] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:41 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 1350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:41.620394 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6035c490-d5ab-4118-a5f4-0685369f8bc6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:41.622512 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6035c490-d5ab-4118-a5f4-0685369f8bc6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:41.637906 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6035c490-d5ab-4118-a5f4-0685369f8bc6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.639245 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6035c490-d5ab-4118-a5f4-0685369f8bc6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.640450 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6035c490-d5ab-4118-a5f4-0685369f8bc6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.642240 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6035c490-d5ab-4118-a5f4-0685369f8bc6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.643674 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6035c490-d5ab-4118-a5f4-0685369f8bc6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.646556 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6035c490-d5ab-4118-a5f4-0685369f8bc6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.682961 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:41.969585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6035c490-d5ab-4118-a5f4-0685369f8bc6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.007453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6035c490-d5ab-4118-a5f4-0685369f8bc6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.395933 Aug 31 00:21:42.023886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 55/117] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:41 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:42.337620 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-93aec9af-ef5f-4083-8697-30822ebc0f9c req-4db9fe17-7435-451b-ad82-629c22ef1768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d377dbb-6731-491e-bc79-3c63e6eb99a0", "tag": "7e5edb05-f5b5-4c24-a6ca-7eb658fb8ce2"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:42.354794 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-93aec9af-ef5f-4083-8697-30822ebc0f9c req-4db9fe17-7435-451b-ad82-629c22ef1768 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.356842 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-93aec9af-ef5f-4083-8697-30822ebc0f9c req-4db9fe17-7435-451b-ad82-629c22ef1768 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.357551 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-93aec9af-ef5f-4083-8697-30822ebc0f9c req-4db9fe17-7435-451b-ad82-629c22ef1768 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.377539 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-93aec9af-ef5f-4083-8697-30822ebc0f9c req-4db9fe17-7435-451b-ad82-629c22ef1768 service nova] Creating event network-changed:7e5edb05-f5b5-4c24-a6ca-7eb658fb8ce2 for instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 on hv-cinder-85221 Aug 31 00:21:42.389996 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-93aec9af-ef5f-4083-8697-30822ebc0f9c req-4db9fe17-7435-451b-ad82-629c22ef1768 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056087 Aug 31 00:21:42.391883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 63/118] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:42.468453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:42.469339 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:42.477149 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.478037 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.478724 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.479695 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.480424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.481085 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.497983 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] HTTP exception thrown: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Request method failure captured: Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 HTTP/1.1 Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqlWXn8CDPeWuAMz8TpQlvFf_dz2_9i0e46-ShuPYZiTimJrmxEk327B4sSB2JoObrpbuHSPKbXgBwNfEK1HYRkYjRww7ZR9FIBMdbz-2H141hmP6CaWFqDMzkU0K7JenBBCpwCXsPyXsnrZbD3h6Y49j5hmjOfFgWVp6VLKQFPxRus Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: d3406349e71d4d96bd33248ce77d5066 Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:21:42.503555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d3406349e71d4d96bd33248ce77d5066"}]}] Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: d3406349e71d4d96bd33248ce77d5066 Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-DeleteServersTestJSON-1099614157-project Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: 2ae7c3709577481b8661ccd80369bd4a Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-DeleteServersTestJSON-1099614157-project Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:42.505697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': 'bfccff9c-84bb-4098-b492-f54f05b3ebd1'} Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:21:42.506390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:42.507475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:21:42.508531 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Returning 404 to user: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:21:42.508531 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-04951d0f-e985-4bd8-85a3-4c0de549f9e7 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 404 len: 111 microversion: 2.1 time: 0.041559 Aug 31 00:21:42.510515 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 56/119] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:42 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:21:42.814248 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:42.834937 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:42.861194 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.862545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.863658 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.865340 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.866443 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.867486 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.898800 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] HTTP exception thrown: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Request method failure captured: Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1/os-volume_attachments HTTP/1.1 Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlWXn8CDPeWuAMz8TpQlvFf_dz2_9i0e46-ShuPYZiTimJrmxEk327B4sSB2JoObrpbuHSPKbXgBwNfEK1HYRkYjRww7ZR9FIBMdbz-2H141hmP6CaWFqDMzkU0K7JenBBCpwCXsPyXsnrZbD3h6Y49j5hmjOfFgWVp6VLKQFPxRus Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: d3406349e71d4d96bd33248ce77d5066 Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:21:42.911040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d3406349e71d4d96bd33248ce77d5066"}]}] Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: d3406349e71d4d96bd33248ce77d5066 Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-DeleteServersTestJSON-1099614157-project Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 2ae7c3709577481b8661ccd80369bd4a Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-DeleteServersTestJSON-1099614157-project Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:42.913839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'server_id': 'bfccff9c-84bb-4098-b492-f54f05b3ebd1'} Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:21:42.915219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:42.919116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:21:42.929615 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Returning 404 to user: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:21:42.929615 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-415b1df5-763f-444d-9a06-bf8c69df606c tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.127653 Aug 31 00:21:42.930274 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 64/120] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:21:42 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1/os-volume_attachments => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:21:43.037436 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-083e0c23-a7ff-4fe3-8c59-2c718d3a6219 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:43.042050 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-083e0c23-a7ff-4fe3-8c59-2c718d3a6219 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:43.065365 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-083e0c23-a7ff-4fe3-8c59-2c718d3a6219 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.066469 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-083e0c23-a7ff-4fe3-8c59-2c718d3a6219 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.075468 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-083e0c23-a7ff-4fe3-8c59-2c718d3a6219 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.083471 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-083e0c23-a7ff-4fe3-8c59-2c718d3a6219 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.084845 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-083e0c23-a7ff-4fe3-8c59-2c718d3a6219 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.089840 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-083e0c23-a7ff-4fe3-8c59-2c718d3a6219 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.609580 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-083e0c23-a7ff-4fe3-8c59-2c718d3a6219 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:43.618915 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-083e0c23-a7ff-4fe3-8c59-2c718d3a6219 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.590698 Aug 31 00:21:43.623281 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 57/121] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:43 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:44.319111 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:44.321227 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:44.337863 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.338955 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.339948 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.341258 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.342265 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.343164 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.373250 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] HTTP exception thrown: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Request method failure captured: Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: DELETE /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 HTTP/1.1 Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlWXn8CDPeWuAMz8TpQlvFf_dz2_9i0e46-ShuPYZiTimJrmxEk327B4sSB2JoObrpbuHSPKbXgBwNfEK1HYRkYjRww7ZR9FIBMdbz-2H141hmP6CaWFqDMzkU0K7JenBBCpwCXsPyXsnrZbD3h6Y49j5hmjOfFgWVp6VLKQFPxRus Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: d3406349e71d4d96bd33248ce77d5066 Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:21:44.378931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d3406349e71d4d96bd33248ce77d5066"}]}] Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: d3406349e71d4d96bd33248ce77d5066 Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-DeleteServersTestJSON-1099614157-project Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 2ae7c3709577481b8661ccd80369bd4a Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-DeleteServersTestJSON-1099614157-project Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:44.382772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'bfccff9c-84bb-4098-b492-f54f05b3ebd1'} Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:21:44.385087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:44.387959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:21:44.390351 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Returning 404 to user: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:21:44.390351 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-768d119b-cdca-4f8f-a5dd-aeb1b9184c77 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 404 len: 111 microversion: 2.1 time: 0.072224 Aug 31 00:21:44.392381 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 65/122] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:21:44 2022] DELETE /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:21:44.407045 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:44.409240 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] [instance: bfccff9c-84bb-4098-b492-f54f05b3ebd1] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:44.424185 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.425304 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.426111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.427595 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.428449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.429197 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.452144 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] HTTP exception thrown: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Request method failure captured: Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 HTTP/1.1 Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqlWXn8CDPeWuAMz8TpQlvFf_dz2_9i0e46-ShuPYZiTimJrmxEk327B4sSB2JoObrpbuHSPKbXgBwNfEK1HYRkYjRww7ZR9FIBMdbz-2H141hmP6CaWFqDMzkU0K7JenBBCpwCXsPyXsnrZbD3h6Y49j5hmjOfFgWVp6VLKQFPxRus Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: d3406349e71d4d96bd33248ce77d5066 Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:21:44.454043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d3406349e71d4d96bd33248ce77d5066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d3406349e71d4d96bd33248ce77d5066"}]}] Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: d3406349e71d4d96bd33248ce77d5066 Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-DeleteServersTestJSON-1099614157 Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-DeleteServersTestJSON-1099614157-project Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: 2ae7c3709577481b8661ccd80369bd4a Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-DeleteServersTestJSON-1099614157-project Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:44.455377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': 'bfccff9c-84bb-4098-b492-f54f05b3ebd1'} Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:21:44.456102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. Aug 31 00:21:44.457379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:21:44.461525 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] Returning 404 to user: Instance bfccff9c-84bb-4098-b492-f54f05b3ebd1 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:21:44.463592 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2bc79a73-aca5-4138-940d-63c10c2dbd97 tempest-DeleteServersTestJSON-1099614157 tempest-DeleteServersTestJSON-1099614157-project] 10.222.0.47 "GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1" status: 404 len: 111 microversion: 2.1 time: 0.065026 Aug 31 00:21:44.464935 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 58/123] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:44 2022] GET /compute/v2.1/servers/bfccff9c-84bb-4098-b492-f54f05b3ebd1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:21:44.647304 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-375d0a7e-4548-43d2-b333-16de5cfd574f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:44.648300 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-375d0a7e-4548-43d2-b333-16de5cfd574f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:44.656741 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-375d0a7e-4548-43d2-b333-16de5cfd574f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.657846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-375d0a7e-4548-43d2-b333-16de5cfd574f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.658675 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-375d0a7e-4548-43d2-b333-16de5cfd574f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.659717 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-375d0a7e-4548-43d2-b333-16de5cfd574f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.660308 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-375d0a7e-4548-43d2-b333-16de5cfd574f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.661548 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-375d0a7e-4548-43d2-b333-16de5cfd574f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:45.190170 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-375d0a7e-4548-43d2-b333-16de5cfd574f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:45.211541 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-375d0a7e-4548-43d2-b333-16de5cfd574f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.569004 Aug 31 00:21:45.214700 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 66/124] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:44 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:46.239395 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-50fabfe6-1d3e-4946-a8f6-808f22772fa5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:46.241507 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-50fabfe6-1d3e-4946-a8f6-808f22772fa5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:46.258402 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-50fabfe6-1d3e-4946-a8f6-808f22772fa5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.259642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-50fabfe6-1d3e-4946-a8f6-808f22772fa5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.260714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-50fabfe6-1d3e-4946-a8f6-808f22772fa5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:46.262269 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-50fabfe6-1d3e-4946-a8f6-808f22772fa5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.263279 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-50fabfe6-1d3e-4946-a8f6-808f22772fa5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.264067 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-50fabfe6-1d3e-4946-a8f6-808f22772fa5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:46.919041 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-50fabfe6-1d3e-4946-a8f6-808f22772fa5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:46.933670 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-50fabfe6-1d3e-4946-a8f6-808f22772fa5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.701242 Aug 31 00:21:46.952357 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 59/125] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:46 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:47.969722 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e4bca416-b791-4755-871a-07ae89041e6a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:47.970542 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e4bca416-b791-4755-871a-07ae89041e6a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:47.979323 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e4bca416-b791-4755-871a-07ae89041e6a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:47.980029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e4bca416-b791-4755-871a-07ae89041e6a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:47.980721 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e4bca416-b791-4755-871a-07ae89041e6a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:47.982196 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e4bca416-b791-4755-871a-07ae89041e6a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:47.982732 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e4bca416-b791-4755-871a-07ae89041e6a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:47.983233 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e4bca416-b791-4755-871a-07ae89041e6a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:48.239831 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e4bca416-b791-4755-871a-07ae89041e6a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:48.268198 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e4bca416-b791-4755-871a-07ae89041e6a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.302923 Aug 31 00:21:48.290305 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 67/126] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:47 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:49.353855 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ec3f2968-c911-4250-9b70-37fcdab68c50 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:49.354881 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ec3f2968-c911-4250-9b70-37fcdab68c50 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:49.371357 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ec3f2968-c911-4250-9b70-37fcdab68c50 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.372103 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ec3f2968-c911-4250-9b70-37fcdab68c50 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.373137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ec3f2968-c911-4250-9b70-37fcdab68c50 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.374535 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ec3f2968-c911-4250-9b70-37fcdab68c50 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.375505 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ec3f2968-c911-4250-9b70-37fcdab68c50 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.376651 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ec3f2968-c911-4250-9b70-37fcdab68c50 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.629233 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ec3f2968-c911-4250-9b70-37fcdab68c50 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:49.637993 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ec3f2968-c911-4250-9b70-37fcdab68c50 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.340143 Aug 31 00:21:49.638616 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 60/127] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:49 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:50.663361 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ee7f2d59-bc50-4231-b116-5f495c86d44d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:50.663859 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ee7f2d59-bc50-4231-b116-5f495c86d44d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:50.672141 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee7f2d59-bc50-4231-b116-5f495c86d44d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.672691 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee7f2d59-bc50-4231-b116-5f495c86d44d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.676659 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee7f2d59-bc50-4231-b116-5f495c86d44d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.681079 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee7f2d59-bc50-4231-b116-5f495c86d44d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.685020 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee7f2d59-bc50-4231-b116-5f495c86d44d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.685660 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee7f2d59-bc50-4231-b116-5f495c86d44d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.017414 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ee7f2d59-bc50-4231-b116-5f495c86d44d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:51.028800 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ee7f2d59-bc50-4231-b116-5f495c86d44d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.369937 Aug 31 00:21:51.029925 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 68/128] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:50 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:52.077312 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-794961fc-1964-433f-8ed0-a799963bf687 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:52.078564 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-794961fc-1964-433f-8ed0-a799963bf687 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:52.091102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-794961fc-1964-433f-8ed0-a799963bf687 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:52.092298 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-794961fc-1964-433f-8ed0-a799963bf687 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:52.093266 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-794961fc-1964-433f-8ed0-a799963bf687 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:52.095888 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-794961fc-1964-433f-8ed0-a799963bf687 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:52.097211 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-794961fc-1964-433f-8ed0-a799963bf687 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:52.097993 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-794961fc-1964-433f-8ed0-a799963bf687 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:52.319808 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-794961fc-1964-433f-8ed0-a799963bf687 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:52.331642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-794961fc-1964-433f-8ed0-a799963bf687 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.263224 Aug 31 00:21:52.344185 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 61/129] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:52 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:52.923651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-bf345d87-b93d-43ce-81d2-36f39e84e9cc tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Action: 'create', calling method: .version_select at 0x7f1a3ac08820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-542571054"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:53.365342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f523c42c-86e5-47ed-8458-211f0022f740 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:53.366225 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f523c42c-86e5-47ed-8458-211f0022f740 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:53.387087 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f523c42c-86e5-47ed-8458-211f0022f740 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.387906 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f523c42c-86e5-47ed-8458-211f0022f740 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.388684 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f523c42c-86e5-47ed-8458-211f0022f740 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.395447 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f523c42c-86e5-47ed-8458-211f0022f740 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.396853 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f523c42c-86e5-47ed-8458-211f0022f740 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.401862 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f523c42c-86e5-47ed-8458-211f0022f740 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.460629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-bf345d87-b93d-43ce-81d2-36f39e84e9cc tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.683106 Aug 31 00:21:53.461764 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 69/130] 10.222.0.47 () {60 vars in 1155 bytes} [Wed Aug 31 00:21:52 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 686 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 00:21:53.484984 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b426c929-91a0-4a32-815c-3ed46bab1996 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3ab8d5e0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:53.571341 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b426c929-91a0-4a32-815c-3ed46bab1996 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726" status: 200 len: 344 microversion: 2.1 time: 0.093982 Aug 31 00:21:53.572741 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 70/131] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:21:53 2022] GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726 => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:53.686137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f523c42c-86e5-47ed-8458-211f0022f740 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:53.700536 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f523c42c-86e5-47ed-8458-211f0022f740 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.339767 Aug 31 00:21:53.701527 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 62/132] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:53 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:54.592261 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-42be1906-27b7-458f-ab56-f0a41e5719e9 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3ab8dca0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:54.669797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-42be1906-27b7-458f-ab56-f0a41e5719e9 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726" status: 200 len: 345 microversion: 2.1 time: 0.082258 Aug 31 00:21:54.674106 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 71/133] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:21:54 2022] GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726 => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:54.684950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e774781c-ad15-4289-a27b-1293944b4ab8 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Action: 'create', calling method: .version_select at 0x7f1a3aaae5e0>, body: {"snapshot": {"volume_id": "7330bfb3-359e-4cab-8fb8-6c1703611726", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1450267190"}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:54.735978 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8d6735fe-0999-4608-aecc-3c0eee0aa58b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:54.736964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8d6735fe-0999-4608-aecc-3c0eee0aa58b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:54.745306 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d6735fe-0999-4608-aecc-3c0eee0aa58b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.746158 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d6735fe-0999-4608-aecc-3c0eee0aa58b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.746835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d6735fe-0999-4608-aecc-3c0eee0aa58b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.747691 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d6735fe-0999-4608-aecc-3c0eee0aa58b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.748385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d6735fe-0999-4608-aecc-3c0eee0aa58b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.749000 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d6735fe-0999-4608-aecc-3c0eee0aa58b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.978454 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e774781c-ad15-4289-a27b-1293944b4ab8 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.295332 Aug 31 00:21:54.989567 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 63/134] 10.222.0.47 () {60 vars in 1162 bytes} [Wed Aug 31 00:21:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:55.022872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8d6735fe-0999-4608-aecc-3c0eee0aa58b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:55.027153 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7c2b255d-18c1-41ad-aead-45901ba05a9a tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3ac159d0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:55.063934 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8d6735fe-0999-4608-aecc-3c0eee0aa58b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.332100 Aug 31 00:21:55.064950 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 72/135] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:54 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:55.108923 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7c2b255d-18c1-41ad-aead-45901ba05a9a tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce" status: 200 len: 287 microversion: 2.1 time: 0.115399 Aug 31 00:21:55.109778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 64/136] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 31 00:21:54 2022] GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:55.123271 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-28554782-d9bf-4995-b4a3-78417a47c2e3 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3ab8d940>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:55.183715 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-28554782-d9bf-4995-b4a3-78417a47c2e3 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.064895 Aug 31 00:21:55.184931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 73/137] 10.222.0.47 () {58 vars in 1140 bytes} [Wed Aug 31 00:21:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:55.201926 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8d7011c6-328a-44ef-8792-1967ef70868d tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3aaad040>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:55.240368 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8d7011c6-328a-44ef-8792-1967ef70868d tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce" status: 200 len: 287 microversion: 2.1 time: 0.042955 Aug 31 00:21:55.240980 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 65/138] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 31 00:21:55 2022] GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:56.094760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-59197a07-2abb-457d-9acc-b8d4fdbfb142 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:56.095774 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-59197a07-2abb-457d-9acc-b8d4fdbfb142 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:56.110373 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-59197a07-2abb-457d-9acc-b8d4fdbfb142 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.111267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-59197a07-2abb-457d-9acc-b8d4fdbfb142 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.112073 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-59197a07-2abb-457d-9acc-b8d4fdbfb142 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.114015 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-59197a07-2abb-457d-9acc-b8d4fdbfb142 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.114898 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-59197a07-2abb-457d-9acc-b8d4fdbfb142 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.115689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-59197a07-2abb-457d-9acc-b8d4fdbfb142 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.261776 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4713ddb7-c087-48b9-bdca-8772bbe21efe tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3ac67ee0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:56.290007 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-59197a07-2abb-457d-9acc-b8d4fdbfb142 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:56.299727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-59197a07-2abb-457d-9acc-b8d4fdbfb142 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.209788 Aug 31 00:21:56.300456 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 74/139] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:56 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:56.319610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4713ddb7-c087-48b9-bdca-8772bbe21efe tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce" status: 200 len: 287 microversion: 2.1 time: 0.066628 Aug 31 00:21:56.328893 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 66/140] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 31 00:21:56 2022] GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:57.323003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0bf60674-98b1-4eed-a66f-9b66db0085b5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:57.323812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0bf60674-98b1-4eed-a66f-9b66db0085b5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:57.330565 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0bf60674-98b1-4eed-a66f-9b66db0085b5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:57.331426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0bf60674-98b1-4eed-a66f-9b66db0085b5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:57.332087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0bf60674-98b1-4eed-a66f-9b66db0085b5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:57.333382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0bf60674-98b1-4eed-a66f-9b66db0085b5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:57.334310 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0bf60674-98b1-4eed-a66f-9b66db0085b5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:57.335007 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0bf60674-98b1-4eed-a66f-9b66db0085b5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:57.342762 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d3118d1e-4ac7-4335-993c-3d06d4931737 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3aaae310>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:57.386653 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d3118d1e-4ac7-4335-993c-3d06d4931737 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce" status: 200 len: 287 microversion: 2.1 time: 0.051202 Aug 31 00:21:57.387448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 67/141] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 31 00:21:57 2022] GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:57.521066 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0bf60674-98b1-4eed-a66f-9b66db0085b5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:57.523505 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=100 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:57.530932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0bf60674-98b1-4eed-a66f-9b66db0085b5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.212922 Aug 31 00:21:57.531532 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 75/142] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:57 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:58.403924 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-57197485-2801-49ef-834d-89a2c3030bf6 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3aaad4c0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:58.437392 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-57197485-2801-49ef-834d-89a2c3030bf6 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce" status: 200 len: 287 microversion: 2.1 time: 0.038230 Aug 31 00:21:58.437996 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 68/143] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 31 00:21:58 2022] GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:58.569930 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0a391d46-45a2-4e84-a363-e64babed4d2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:58.570669 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0a391d46-45a2-4e84-a363-e64babed4d2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:58.577250 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a391d46-45a2-4e84-a363-e64babed4d2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.577810 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a391d46-45a2-4e84-a363-e64babed4d2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.578330 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a391d46-45a2-4e84-a363-e64babed4d2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.579150 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a391d46-45a2-4e84-a363-e64babed4d2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.579711 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a391d46-45a2-4e84-a363-e64babed4d2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.580171 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0a391d46-45a2-4e84-a363-e64babed4d2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.764899 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0a391d46-45a2-4e84-a363-e64babed4d2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:58.777727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0a391d46-45a2-4e84-a363-e64babed4d2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.213184 Aug 31 00:21:58.778317 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 76/144] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:58 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:59.454362 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-351e9885-7ed2-44ee-aba9-0e3cc026cf69 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3abf0c10>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:59.487875 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-351e9885-7ed2-44ee-aba9-0e3cc026cf69 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce" status: 200 len: 288 microversion: 2.1 time: 0.037933 Aug 31 00:21:59.488833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 69/145] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 31 00:21:59 2022] GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:59.506673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e6dda047-d213-4853-ad96-da31f34430ba tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3ab8d790>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:59.583212 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e6dda047-d213-4853-ad96-da31f34430ba tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce" status: 202 len: 0 microversion: 2.1 time: 0.082907 Aug 31 00:21:59.584197 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 77/146] 10.222.0.47 () {58 vars in 1254 bytes} [Wed Aug 31 00:21:59 2022] DELETE /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:21:59.592813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e0cca9ab-cc8a-4c01-b887-debbb924abda tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3accfe50>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:59.629735 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e0cca9ab-cc8a-4c01-b887-debbb924abda tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce" status: 200 len: 287 microversion: 2.1 time: 0.040994 Aug 31 00:21:59.630595 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 70/147] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 31 00:21:59 2022] GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:59.800638 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ffebe43a-b051-4f7f-b5d0-71f76a00b453 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:59.801353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ffebe43a-b051-4f7f-b5d0-71f76a00b453 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:59.807933 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffebe43a-b051-4f7f-b5d0-71f76a00b453 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:59.808468 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffebe43a-b051-4f7f-b5d0-71f76a00b453 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:59.808915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffebe43a-b051-4f7f-b5d0-71f76a00b453 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:59.809630 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffebe43a-b051-4f7f-b5d0-71f76a00b453 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:59.810083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffebe43a-b051-4f7f-b5d0-71f76a00b453 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:59.810511 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffebe43a-b051-4f7f-b5d0-71f76a00b453 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:59.982237 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ffebe43a-b051-4f7f-b5d0-71f76a00b453 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:00.008414 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ffebe43a-b051-4f7f-b5d0-71f76a00b453 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.199713 Aug 31 00:22:00.008414 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 78/148] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:59 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:00.647656 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7d674eca-d7b8-4513-afec-5683827d67a4 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3aaad820>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:00.683845 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-7d674eca-d7b8-4513-afec-5683827d67a4 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] HTTP exception thrown: Snapshot 54f9774f-6ad6-4d3c-8100-0b45143586ce could not be found. Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7d674eca-d7b8-4513-afec-5683827d67a4 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Request method failure captured: Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce HTTP/1.1 Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqmg0W2oYJbuh5JfJvSAlbOy22ZTctP_1j64IiDTcl7JBOiGoJq1bnelMuGdVih0Im7_pS4KaGahG9E7nc1Nv7n3059f9B3ulzwm-uYH1rNbJqS403RAP55YgNd4XV-U3jGvhF8Bj2burI4yzJdsiKHytIUHkFpLD9xGJ45qwKxkghE Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: 87fb5fe2d3e84551aeb13c1999d9c7e5 Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:22:00.691125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_87fb5fe2d3e84551aeb13c1999d9c7e5"}]}] Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: 87fb5fe2d3e84551aeb13c1999d9c7e5 Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-VolumesSnapshotsTestJSON-982158079-project Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: e91d3b6d368d4ada956e63c0faf2d09b Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-VolumesSnapshotsTestJSON-982158079-project Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Snapshot 54f9774f-6ad6-4d3c-8100-0b45143586ce could not be found. Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '54f9774f-6ad6-4d3c-8100-0b45143586ce'} Aug 31 00:22:00.693967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 54f9774f-6ad6-4d3c-8100-0b45143586ce could not be found. (HTTP 404) (Request-ID: req-189ffd3c-feb1-47d8-bf23-be14a51d975a) Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:00.695590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:22:00.697790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 54f9774f-6ad6-4d3c-8100-0b45143586ce could not be found. Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 00:22:00.700078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 54f9774f-6ad6-4d3c-8100-0b45143586ce could not be found. Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 54f9774f-6ad6-4d3c-8100-0b45143586ce could not be found. Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7d674eca-d7b8-4513-afec-5683827d67a4 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Returning 404 to user: Snapshot 54f9774f-6ad6-4d3c-8100-0b45143586ce could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7d674eca-d7b8-4513-afec-5683827d67a4 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce" status: 404 len: 111 microversion: 2.1 time: 0.051810 Aug 31 00:22:00.702437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 71/149] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 31 00:22:00 2022] GET /compute/v2.1/os-snapshots/54f9774f-6ad6-4d3c-8100-0b45143586ce => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:00.712302 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5dc9a534-e653-49b5-8626-17395cb85d06 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3ab8d700>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:00.795279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5dc9a534-e653-49b5-8626-17395cb85d06 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726" status: 202 len: 0 microversion: 2.1 time: 0.091693 Aug 31 00:22:00.796397 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 79/150] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 31 00:22:00 2022] DELETE /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:22:00.805007 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-20c187d8-46e2-400c-a8a2-b8cce15b0976 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3aaad1f0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:00.893468 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-20c187d8-46e2-400c-a8a2-b8cce15b0976 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726" status: 200 len: 344 microversion: 2.1 time: 0.092363 Aug 31 00:22:00.894285 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 72/151] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:22:00 2022] GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726 => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:01.022707 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-01785542-2ae2-4753-ba76-f556f13e38c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:01.023870 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-01785542-2ae2-4753-ba76-f556f13e38c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:01.034650 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-01785542-2ae2-4753-ba76-f556f13e38c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.035994 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-01785542-2ae2-4753-ba76-f556f13e38c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.036899 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-01785542-2ae2-4753-ba76-f556f13e38c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.038054 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-01785542-2ae2-4753-ba76-f556f13e38c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.038812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-01785542-2ae2-4753-ba76-f556f13e38c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.039442 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-01785542-2ae2-4753-ba76-f556f13e38c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.260914 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-01785542-2ae2-4753-ba76-f556f13e38c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:01.273658 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-01785542-2ae2-4753-ba76-f556f13e38c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.256884 Aug 31 00:22:01.274791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 80/152] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:01 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:01.913469 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f60b50c3-cc87-4eef-a525-24519fc10bae tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3aa808b0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:01.950265 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-f60b50c3-cc87-4eef-a525-24519fc10bae tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] HTTP exception thrown: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f60b50c3-cc87-4eef-a525-24519fc10bae tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Request method failure captured: Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726 HTTP/1.1 Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqmg0W2oYJbuh5JfJvSAlbOy22ZTctP_1j64IiDTcl7JBOiGoJq1bnelMuGdVih0Im7_pS4KaGahG9E7nc1Nv7n3059f9B3ulzwm-uYH1rNbJqS403RAP55YgNd4XV-U3jGvhF8Bj2burI4yzJdsiKHytIUHkFpLD9xGJ45qwKxkghE Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: 87fb5fe2d3e84551aeb13c1999d9c7e5 Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:22:01.953675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_87fb5fe2d3e84551aeb13c1999d9c7e5"}]}] Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: 87fb5fe2d3e84551aeb13c1999d9c7e5 Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-VolumesSnapshotsTestJSON-982158079-project Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: e91d3b6d368d4ada956e63c0faf2d09b Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-VolumesSnapshotsTestJSON-982158079-project Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '7330bfb3-359e-4cab-8fb8-6c1703611726'} Aug 31 00:22:01.956603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. (HTTP 404) (Request-ID: req-dd87599c-5feb-4c04-9d9b-92ff9cb41346) Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:01.959239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:22:01.962801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:22:01.965825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f60b50c3-cc87-4eef-a525-24519fc10bae tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Returning 404 to user: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f60b50c3-cc87-4eef-a525-24519fc10bae tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726" status: 404 len: 109 microversion: 2.1 time: 0.054243 Aug 31 00:22:01.968942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 73/153] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:22:01 2022] GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:01.982223 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2cfa064a-75cd-4639-aa10-5244f739c029 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3ab9fca0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:02.033954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-2cfa064a-75cd-4639-aa10-5244f739c029 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] HTTP exception thrown: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2cfa064a-75cd-4639-aa10-5244f739c029 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Request method failure captured: Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: DELETE /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726 HTTP/1.1 Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqmg0W2oYJbuh5JfJvSAlbOy22ZTctP_1j64IiDTcl7JBOiGoJq1bnelMuGdVih0Im7_pS4KaGahG9E7nc1Nv7n3059f9B3ulzwm-uYH1rNbJqS403RAP55YgNd4XV-U3jGvhF8Bj2burI4yzJdsiKHytIUHkFpLD9xGJ45qwKxkghE Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 87fb5fe2d3e84551aeb13c1999d9c7e5 Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:22:02.037472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_87fb5fe2d3e84551aeb13c1999d9c7e5"}]}] Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 87fb5fe2d3e84551aeb13c1999d9c7e5 Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-VolumesSnapshotsTestJSON-982158079-project Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: e91d3b6d368d4ada956e63c0faf2d09b Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-VolumesSnapshotsTestJSON-982158079-project Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '7330bfb3-359e-4cab-8fb8-6c1703611726'} Aug 31 00:22:02.039821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. (HTTP 404) (Request-ID: req-6d542d8b-4a58-4cc6-93c8-c62167a134ed) Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:02.041424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:22:02.043737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 00:22:02.046100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2cfa064a-75cd-4639-aa10-5244f739c029 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Returning 404 to user: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2cfa064a-75cd-4639-aa10-5244f739c029 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726" status: 404 len: 109 microversion: 2.1 time: 0.065374 Aug 31 00:22:02.048431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 81/154] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 31 00:22:01 2022] DELETE /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:02.052877 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ba049019-8e86-4d3f-90b2-34ba5bf73e28 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Calling method '.version_select at 0x7f1a3aaad430>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:02.083801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-ba049019-8e86-4d3f-90b2-34ba5bf73e28 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] HTTP exception thrown: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ba049019-8e86-4d3f-90b2-34ba5bf73e28 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Request method failure captured: Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726 HTTP/1.1 Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqmg0W2oYJbuh5JfJvSAlbOy22ZTctP_1j64IiDTcl7JBOiGoJq1bnelMuGdVih0Im7_pS4KaGahG9E7nc1Nv7n3059f9B3ulzwm-uYH1rNbJqS403RAP55YgNd4XV-U3jGvhF8Bj2burI4yzJdsiKHytIUHkFpLD9xGJ45qwKxkghE Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: 87fb5fe2d3e84551aeb13c1999d9c7e5 Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:22:02.085922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/87fb5fe2d3e84551aeb13c1999d9c7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_87fb5fe2d3e84551aeb13c1999d9c7e5"}]}] Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: 87fb5fe2d3e84551aeb13c1999d9c7e5 Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-982158079 Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-VolumesSnapshotsTestJSON-982158079-project Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: e91d3b6d368d4ada956e63c0faf2d09b Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-VolumesSnapshotsTestJSON-982158079-project Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '7330bfb3-359e-4cab-8fb8-6c1703611726'} Aug 31 00:22:02.088060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. (HTTP 404) (Request-ID: req-a517dc45-5881-4e0b-8fd7-b49beb6a661d) Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:02.089589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:22:02.091517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:22:02.093632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ba049019-8e86-4d3f-90b2-34ba5bf73e28 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] Returning 404 to user: Volume 7330bfb3-359e-4cab-8fb8-6c1703611726 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ba049019-8e86-4d3f-90b2-34ba5bf73e28 tempest-VolumesSnapshotsTestJSON-982158079 tempest-VolumesSnapshotsTestJSON-982158079-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726" status: 404 len: 109 microversion: 2.1 time: 0.042052 Aug 31 00:22:02.095501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 74/155] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:22:02 2022] GET /compute/v2.1/os-volumes/7330bfb3-359e-4cab-8fb8-6c1703611726 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:02.301752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1bc7def7-7cd5-4bb2-929f-2430322dfd9e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:02.302717 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1bc7def7-7cd5-4bb2-929f-2430322dfd9e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:02.311716 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=50 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:02.317147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bc7def7-7cd5-4bb2-929f-2430322dfd9e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:02.318600 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bc7def7-7cd5-4bb2-929f-2430322dfd9e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:02.319656 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bc7def7-7cd5-4bb2-929f-2430322dfd9e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:02.321762 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bc7def7-7cd5-4bb2-929f-2430322dfd9e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:02.322091 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bc7def7-7cd5-4bb2-929f-2430322dfd9e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:02.322881 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bc7def7-7cd5-4bb2-929f-2430322dfd9e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:02.507964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1bc7def7-7cd5-4bb2-929f-2430322dfd9e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:02.518499 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1bc7def7-7cd5-4bb2-929f-2430322dfd9e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.222702 Aug 31 00:22:02.519288 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 82/156] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:02 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:03.553699 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:03.560874 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f735c2aa-e98b-4903-b8d2-fe84a312bd34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:03.561606 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f735c2aa-e98b-4903-b8d2-fe84a312bd34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:03.571511 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f735c2aa-e98b-4903-b8d2-fe84a312bd34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.572094 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f735c2aa-e98b-4903-b8d2-fe84a312bd34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.572627 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f735c2aa-e98b-4903-b8d2-fe84a312bd34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:03.573460 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f735c2aa-e98b-4903-b8d2-fe84a312bd34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.574094 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f735c2aa-e98b-4903-b8d2-fe84a312bd34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.574538 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f735c2aa-e98b-4903-b8d2-fe84a312bd34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:03.792179 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f735c2aa-e98b-4903-b8d2-fe84a312bd34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:03.803298 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f735c2aa-e98b-4903-b8d2-fe84a312bd34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.255288 Aug 31 00:22:03.804123 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 75/157] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:03 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:04.828507 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ea05666b-b34e-4b71-8d5d-d5c8c9437320 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:04.829532 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ea05666b-b34e-4b71-8d5d-d5c8c9437320 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:04.838731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea05666b-b34e-4b71-8d5d-d5c8c9437320 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:04.839436 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea05666b-b34e-4b71-8d5d-d5c8c9437320 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:04.840227 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea05666b-b34e-4b71-8d5d-d5c8c9437320 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:04.841191 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea05666b-b34e-4b71-8d5d-d5c8c9437320 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:04.841979 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea05666b-b34e-4b71-8d5d-d5c8c9437320 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:04.842672 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea05666b-b34e-4b71-8d5d-d5c8c9437320 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.097184 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ea05666b-b34e-4b71-8d5d-d5c8c9437320 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:05.112240 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ea05666b-b34e-4b71-8d5d-d5c8c9437320 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.289412 Aug 31 00:22:05.114179 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 83/158] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:04 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:06.140534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-0c995c36-392c-4a88-87f6-13615a6f3217 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:06.141375 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-0c995c36-392c-4a88-87f6-13615a6f3217 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:06.151011 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0c995c36-392c-4a88-87f6-13615a6f3217 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:06.151778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0c995c36-392c-4a88-87f6-13615a6f3217 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:06.152575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0c995c36-392c-4a88-87f6-13615a6f3217 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:06.153962 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0c995c36-392c-4a88-87f6-13615a6f3217 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:06.155092 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0c995c36-392c-4a88-87f6-13615a6f3217 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:06.155926 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0c995c36-392c-4a88-87f6-13615a6f3217 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:06.552337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-0c995c36-392c-4a88-87f6-13615a6f3217 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:06.560325 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-0c995c36-392c-4a88-87f6-13615a6f3217 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.425234 Aug 31 00:22:06.560918 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 76/159] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:06 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:07.589801 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-eecf2c2f-3fb4-4001-bf8a-d998a0a05a41 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:07.590917 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-eecf2c2f-3fb4-4001-bf8a-d998a0a05a41 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:07.603235 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eecf2c2f-3fb4-4001-bf8a-d998a0a05a41 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:07.604127 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eecf2c2f-3fb4-4001-bf8a-d998a0a05a41 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:07.604979 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eecf2c2f-3fb4-4001-bf8a-d998a0a05a41 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:07.606365 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eecf2c2f-3fb4-4001-bf8a-d998a0a05a41 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:07.607238 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eecf2c2f-3fb4-4001-bf8a-d998a0a05a41 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:07.608043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eecf2c2f-3fb4-4001-bf8a-d998a0a05a41 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:07.772566 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-eecf2c2f-3fb4-4001-bf8a-d998a0a05a41 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:07.781648 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-eecf2c2f-3fb4-4001-bf8a-d998a0a05a41 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.199976 Aug 31 00:22:07.782216 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 84/160] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:07 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:08.805216 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-99a171e2-de04-4d89-98ce-c5da4653d582 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:08.806245 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-99a171e2-de04-4d89-98ce-c5da4653d582 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:08.817627 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99a171e2-de04-4d89-98ce-c5da4653d582 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:08.818328 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99a171e2-de04-4d89-98ce-c5da4653d582 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:08.819058 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99a171e2-de04-4d89-98ce-c5da4653d582 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:08.820296 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99a171e2-de04-4d89-98ce-c5da4653d582 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:08.821070 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99a171e2-de04-4d89-98ce-c5da4653d582 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:08.821888 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99a171e2-de04-4d89-98ce-c5da4653d582 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:09.036871 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-99a171e2-de04-4d89-98ce-c5da4653d582 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:09.045643 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-99a171e2-de04-4d89-98ce-c5da4653d582 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.246167 Aug 31 00:22:09.046242 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 77/161] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:08 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:10.071559 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7e128cbf-a0a6-4b2e-a36f-98036f1b18c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:10.072644 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7e128cbf-a0a6-4b2e-a36f-98036f1b18c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:10.084044 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e128cbf-a0a6-4b2e-a36f-98036f1b18c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:10.084920 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e128cbf-a0a6-4b2e-a36f-98036f1b18c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:10.085643 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e128cbf-a0a6-4b2e-a36f-98036f1b18c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:10.086849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e128cbf-a0a6-4b2e-a36f-98036f1b18c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:10.087638 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e128cbf-a0a6-4b2e-a36f-98036f1b18c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:10.088403 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e128cbf-a0a6-4b2e-a36f-98036f1b18c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:10.247553 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7e128cbf-a0a6-4b2e-a36f-98036f1b18c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:10.263858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7e128cbf-a0a6-4b2e-a36f-98036f1b18c2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.198904 Aug 31 00:22:10.265044 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 85/162] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:10 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:11.302260 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-584a15e3-6310-41e6-87c2-19c4bd7c3b0c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:11.302954 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-584a15e3-6310-41e6-87c2-19c4bd7c3b0c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:11.309815 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-584a15e3-6310-41e6-87c2-19c4bd7c3b0c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:11.310314 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-584a15e3-6310-41e6-87c2-19c4bd7c3b0c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:11.310745 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-584a15e3-6310-41e6-87c2-19c4bd7c3b0c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:11.311458 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-584a15e3-6310-41e6-87c2-19c4bd7c3b0c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:11.311913 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-584a15e3-6310-41e6-87c2-19c4bd7c3b0c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:11.312371 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-584a15e3-6310-41e6-87c2-19c4bd7c3b0c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:11.481378 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-584a15e3-6310-41e6-87c2-19c4bd7c3b0c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:11.496142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-584a15e3-6310-41e6-87c2-19c4bd7c3b0c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.198268 Aug 31 00:22:11.497157 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 78/163] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:11 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:12.521578 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5623567e-3462-439c-b4b9-4dd31d78820c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:12.522166 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5623567e-3462-439c-b4b9-4dd31d78820c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:12.529561 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5623567e-3462-439c-b4b9-4dd31d78820c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:12.530150 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5623567e-3462-439c-b4b9-4dd31d78820c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:12.530644 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5623567e-3462-439c-b4b9-4dd31d78820c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:12.531532 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5623567e-3462-439c-b4b9-4dd31d78820c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:12.532084 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5623567e-3462-439c-b4b9-4dd31d78820c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:12.532624 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5623567e-3462-439c-b4b9-4dd31d78820c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:12.704038 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5623567e-3462-439c-b4b9-4dd31d78820c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:12.714057 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5623567e-3462-439c-b4b9-4dd31d78820c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.198336 Aug 31 00:22:12.714648 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 86/164] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:12 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:13.743293 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f4c80cf5-95de-480f-a7a8-3c2c3ba3c597 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:13.744499 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f4c80cf5-95de-480f-a7a8-3c2c3ba3c597 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:13.759286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4c80cf5-95de-480f-a7a8-3c2c3ba3c597 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:13.760501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4c80cf5-95de-480f-a7a8-3c2c3ba3c597 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:13.761299 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4c80cf5-95de-480f-a7a8-3c2c3ba3c597 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:13.762626 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4c80cf5-95de-480f-a7a8-3c2c3ba3c597 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:13.763477 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4c80cf5-95de-480f-a7a8-3c2c3ba3c597 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:13.764371 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4c80cf5-95de-480f-a7a8-3c2c3ba3c597 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:13.778607 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=62 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:14.031145 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f4c80cf5-95de-480f-a7a8-3c2c3ba3c597 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:14.045965 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f4c80cf5-95de-480f-a7a8-3c2c3ba3c597 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.311972 Aug 31 00:22:14.047010 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 79/165] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:13 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:15.076423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0e6e7c77-b43a-4737-abf4-7e88a4522c17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:15.077293 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0e6e7c77-b43a-4737-abf4-7e88a4522c17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:15.085400 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6e7c77-b43a-4737-abf4-7e88a4522c17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:15.085925 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6e7c77-b43a-4737-abf4-7e88a4522c17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:15.086672 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6e7c77-b43a-4737-abf4-7e88a4522c17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:15.087577 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6e7c77-b43a-4737-abf4-7e88a4522c17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:15.088119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6e7c77-b43a-4737-abf4-7e88a4522c17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:15.088599 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6e7c77-b43a-4737-abf4-7e88a4522c17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:15.313497 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0e6e7c77-b43a-4737-abf4-7e88a4522c17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:15.328847 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0e6e7c77-b43a-4737-abf4-7e88a4522c17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1520 microversion: 2.1 time: 0.256160 Aug 31 00:22:15.329886 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 87/166] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:15 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:16.354678 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-af04be66-1816-4c86-9690-6efa38a7d0f3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:16.355571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-af04be66-1816-4c86-9690-6efa38a7d0f3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:16.365933 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-af04be66-1816-4c86-9690-6efa38a7d0f3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.366811 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-af04be66-1816-4c86-9690-6efa38a7d0f3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.367544 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-af04be66-1816-4c86-9690-6efa38a7d0f3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.368858 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-af04be66-1816-4c86-9690-6efa38a7d0f3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.369690 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-af04be66-1816-4c86-9690-6efa38a7d0f3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.370470 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-af04be66-1816-4c86-9690-6efa38a7d0f3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.592019 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-af04be66-1816-4c86-9690-6efa38a7d0f3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:16.607877 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-af04be66-1816-4c86-9690-6efa38a7d0f3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1500 microversion: 2.1 time: 0.257965 Aug 31 00:22:16.609047 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 80/167] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:16 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1500 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:16.645427 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-19c3aa7c-7953-4962-9d29-ad3b0ffae80c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:16.646208 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-19c3aa7c-7953-4962-9d29-ad3b0ffae80c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:16.654806 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-19c3aa7c-7953-4962-9d29-ad3b0ffae80c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.655425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-19c3aa7c-7953-4962-9d29-ad3b0ffae80c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.655982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-19c3aa7c-7953-4962-9d29-ad3b0ffae80c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.656790 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-19c3aa7c-7953-4962-9d29-ad3b0ffae80c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.657343 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-19c3aa7c-7953-4962-9d29-ad3b0ffae80c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.657823 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-19c3aa7c-7953-4962-9d29-ad3b0ffae80c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.892512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-19c3aa7c-7953-4962-9d29-ad3b0ffae80c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:16.907817 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-19c3aa7c-7953-4962-9d29-ad3b0ffae80c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1513 microversion: 2.1 time: 0.268618 Aug 31 00:22:16.910649 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 88/168] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:16 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:18.419925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7cf1e0ec-e478-4fb1-a1f0-f550ae5854b9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:18.421956 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7cf1e0ec-e478-4fb1-a1f0-f550ae5854b9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:18.449946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7cf1e0ec-e478-4fb1-a1f0-f550ae5854b9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:18.450633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7cf1e0ec-e478-4fb1-a1f0-f550ae5854b9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:18.451949 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7cf1e0ec-e478-4fb1-a1f0-f550ae5854b9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:18.453284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7cf1e0ec-e478-4fb1-a1f0-f550ae5854b9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:18.454197 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7cf1e0ec-e478-4fb1-a1f0-f550ae5854b9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:18.455253 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7cf1e0ec-e478-4fb1-a1f0-f550ae5854b9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:18.506692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7cf1e0ec-e478-4fb1-a1f0-f550ae5854b9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/ips" status: 200 len: 145 microversion: 2.1 time: 0.093845 Aug 31 00:22:18.507737 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 81/169] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 31 00:22:18 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/ips => generated 145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:18.612870 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-46ccfe27-30b6-426b-a363-5187d55b74a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:18.617031 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-46ccfe27-30b6-426b-a363-5187d55b74a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:18.632743 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46ccfe27-30b6-426b-a363-5187d55b74a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:18.634128 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46ccfe27-30b6-426b-a363-5187d55b74a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:18.635319 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46ccfe27-30b6-426b-a363-5187d55b74a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:18.637387 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46ccfe27-30b6-426b-a363-5187d55b74a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:18.638278 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46ccfe27-30b6-426b-a363-5187d55b74a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:18.639116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46ccfe27-30b6-426b-a363-5187d55b74a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:18.688211 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-46ccfe27-30b6-426b-a363-5187d55b74a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lazy-loading 'flavor' on Instance uuid 379d25b6-01b5-4bed-ba25-2f169d66600b {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:22:18.902274 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-46ccfe27-30b6-426b-a363-5187d55b74a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "POST /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b/action" status: 200 len: 32 microversion: 2.1 time: 0.293375 Aug 31 00:22:18.904119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 89/170] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:22:18 2022] POST /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:22:18.923082 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1895ef1b-01a4-4d88-8342-f3256d1b1289 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:18.924994 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1895ef1b-01a4-4d88-8342-f3256d1b1289 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:18.934520 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1895ef1b-01a4-4d88-8342-f3256d1b1289 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:18.935152 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1895ef1b-01a4-4d88-8342-f3256d1b1289 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:18.935941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1895ef1b-01a4-4d88-8342-f3256d1b1289 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:18.936857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1895ef1b-01a4-4d88-8342-f3256d1b1289 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:18.937546 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1895ef1b-01a4-4d88-8342-f3256d1b1289 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:18.938255 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1895ef1b-01a4-4d88-8342-f3256d1b1289 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:19.311285 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1895ef1b-01a4-4d88-8342-f3256d1b1289 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:19.320486 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1895ef1b-01a4-4d88-8342-f3256d1b1289 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.404430 Aug 31 00:22:19.321695 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 82/171] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:18 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:20.358223 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-21076d8c-2d6f-4087-8dc9-77b9e5cc6963 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:20.358940 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-21076d8c-2d6f-4087-8dc9-77b9e5cc6963 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:20.367238 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-21076d8c-2d6f-4087-8dc9-77b9e5cc6963 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:20.367789 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-21076d8c-2d6f-4087-8dc9-77b9e5cc6963 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:20.368395 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-21076d8c-2d6f-4087-8dc9-77b9e5cc6963 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:20.371750 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-21076d8c-2d6f-4087-8dc9-77b9e5cc6963 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:20.371750 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-21076d8c-2d6f-4087-8dc9-77b9e5cc6963 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:20.371750 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-21076d8c-2d6f-4087-8dc9-77b9e5cc6963 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:20.578790 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-21076d8c-2d6f-4087-8dc9-77b9e5cc6963 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:20.589626 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-21076d8c-2d6f-4087-8dc9-77b9e5cc6963 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.235815 Aug 31 00:22:20.592222 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 90/172] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:20 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:21.625343 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f9346321-4345-457a-ad11-2d6efb6f4542 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:21.626300 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f9346321-4345-457a-ad11-2d6efb6f4542 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:21.636409 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9346321-4345-457a-ad11-2d6efb6f4542 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:21.637005 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9346321-4345-457a-ad11-2d6efb6f4542 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:21.637633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9346321-4345-457a-ad11-2d6efb6f4542 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:21.638659 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9346321-4345-457a-ad11-2d6efb6f4542 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:21.639361 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9346321-4345-457a-ad11-2d6efb6f4542 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:21.639982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9346321-4345-457a-ad11-2d6efb6f4542 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:21.875426 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f9346321-4345-457a-ad11-2d6efb6f4542 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:21.888460 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f9346321-4345-457a-ad11-2d6efb6f4542 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.266726 Aug 31 00:22:21.890633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 83/173] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:21 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:22.919837 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a4f55184-6bc9-489b-b004-182fda20ada2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:22.920930 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a4f55184-6bc9-489b-b004-182fda20ada2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:22.931300 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a4f55184-6bc9-489b-b004-182fda20ada2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:22.932184 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a4f55184-6bc9-489b-b004-182fda20ada2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:22.932964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a4f55184-6bc9-489b-b004-182fda20ada2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:22.934215 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a4f55184-6bc9-489b-b004-182fda20ada2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:22.934986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a4f55184-6bc9-489b-b004-182fda20ada2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:22.935832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a4f55184-6bc9-489b-b004-182fda20ada2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.201692 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a4f55184-6bc9-489b-b004-182fda20ada2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:23.217446 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a4f55184-6bc9-489b-b004-182fda20ada2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.303128 Aug 31 00:22:23.218549 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 91/174] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:22 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:24.246458 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ad041abd-db8b-453a-af68-cf5d4319af1a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:24.247576 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ad041abd-db8b-453a-af68-cf5d4319af1a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:24.261930 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad041abd-db8b-453a-af68-cf5d4319af1a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:24.262776 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad041abd-db8b-453a-af68-cf5d4319af1a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:24.263698 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad041abd-db8b-453a-af68-cf5d4319af1a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:24.264964 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad041abd-db8b-453a-af68-cf5d4319af1a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:24.265737 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad041abd-db8b-453a-af68-cf5d4319af1a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:24.266470 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad041abd-db8b-453a-af68-cf5d4319af1a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:24.493930 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ad041abd-db8b-453a-af68-cf5d4319af1a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:24.502896 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ad041abd-db8b-453a-af68-cf5d4319af1a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.263964 Aug 31 00:22:24.516425 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 84/175] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:24 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:25.528384 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f28bebde-4277-49c7-9849-4c970e351293 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:25.529161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f28bebde-4277-49c7-9849-4c970e351293 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:25.545295 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f28bebde-4277-49c7-9849-4c970e351293 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:25.546190 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f28bebde-4277-49c7-9849-4c970e351293 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:25.547042 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f28bebde-4277-49c7-9849-4c970e351293 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:25.548351 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f28bebde-4277-49c7-9849-4c970e351293 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:25.549553 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f28bebde-4277-49c7-9849-4c970e351293 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:25.551298 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f28bebde-4277-49c7-9849-4c970e351293 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:25.743296 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f28bebde-4277-49c7-9849-4c970e351293 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:25.755132 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f28bebde-4277-49c7-9849-4c970e351293 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.233698 Aug 31 00:22:25.755731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 92/176] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:25 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:25.877817 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8492f1e9-71d2-414b-a4a7-afbb9f1baab6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4066e108-dc69-4e45-bdbd-a947e3c648df"}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:25.882799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8492f1e9-71d2-414b-a4a7-afbb9f1baab6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:25.896876 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8492f1e9-71d2-414b-a4a7-afbb9f1baab6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:25.898206 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8492f1e9-71d2-414b-a4a7-afbb9f1baab6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:25.900072 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8492f1e9-71d2-414b-a4a7-afbb9f1baab6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:25.901759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8492f1e9-71d2-414b-a4a7-afbb9f1baab6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:25.903128 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8492f1e9-71d2-414b-a4a7-afbb9f1baab6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:25.904183 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8492f1e9-71d2-414b-a4a7-afbb9f1baab6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:26.342054 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8492f1e9-71d2-414b-a4a7-afbb9f1baab6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "POST /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.470802 Aug 31 00:22:26.349735 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 85/177] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:22:25 2022] POST /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:26.778308 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e81e444d-32b5-42f2-8854-00555f2e4e38 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:26.779161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e81e444d-32b5-42f2-8854-00555f2e4e38 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:26.786954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e81e444d-32b5-42f2-8854-00555f2e4e38 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:26.787722 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e81e444d-32b5-42f2-8854-00555f2e4e38 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:26.788298 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e81e444d-32b5-42f2-8854-00555f2e4e38 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:26.789494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e81e444d-32b5-42f2-8854-00555f2e4e38 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:26.790163 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e81e444d-32b5-42f2-8854-00555f2e4e38 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:26.790845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e81e444d-32b5-42f2-8854-00555f2e4e38 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:26.814247 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:27.057661 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e81e444d-32b5-42f2-8854-00555f2e4e38 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:27.072881 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e81e444d-32b5-42f2-8854-00555f2e4e38 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.299799 Aug 31 00:22:27.073945 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 93/178] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:26 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:28.109668 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d1d0eb53-0cd6-423f-a54c-d5ea4c5008d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:28.110509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d1d0eb53-0cd6-423f-a54c-d5ea4c5008d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:28.118152 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d1d0eb53-0cd6-423f-a54c-d5ea4c5008d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:28.118917 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d1d0eb53-0cd6-423f-a54c-d5ea4c5008d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:28.119635 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d1d0eb53-0cd6-423f-a54c-d5ea4c5008d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:28.120655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d1d0eb53-0cd6-423f-a54c-d5ea4c5008d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:28.121290 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d1d0eb53-0cd6-423f-a54c-d5ea4c5008d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:28.121714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d1d0eb53-0cd6-423f-a54c-d5ea4c5008d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:28.388981 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d1d0eb53-0cd6-423f-a54c-d5ea4c5008d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:28.412589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d1d0eb53-0cd6-423f-a54c-d5ea4c5008d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.307392 Aug 31 00:22:28.413991 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 86/179] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:28 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:29.452147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7684056f-72af-48aa-9172-52ca9ff28e51 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:29.453105 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7684056f-72af-48aa-9172-52ca9ff28e51 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:29.465183 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7684056f-72af-48aa-9172-52ca9ff28e51 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:29.466069 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7684056f-72af-48aa-9172-52ca9ff28e51 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:29.466848 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7684056f-72af-48aa-9172-52ca9ff28e51 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:29.468110 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7684056f-72af-48aa-9172-52ca9ff28e51 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:29.468955 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7684056f-72af-48aa-9172-52ca9ff28e51 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:29.469709 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7684056f-72af-48aa-9172-52ca9ff28e51 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:29.690209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7684056f-72af-48aa-9172-52ca9ff28e51 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:29.699187 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7684056f-72af-48aa-9172-52ca9ff28e51 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.253454 Aug 31 00:22:29.699790 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 94/180] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:29 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:30.737639 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3f771648-fd2b-4a90-bee2-96e054cbda52 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:30.738783 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3f771648-fd2b-4a90-bee2-96e054cbda52 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:30.750658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f771648-fd2b-4a90-bee2-96e054cbda52 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:30.751524 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f771648-fd2b-4a90-bee2-96e054cbda52 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:30.752326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f771648-fd2b-4a90-bee2-96e054cbda52 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:30.753442 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f771648-fd2b-4a90-bee2-96e054cbda52 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:30.754142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f771648-fd2b-4a90-bee2-96e054cbda52 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:30.754826 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f771648-fd2b-4a90-bee2-96e054cbda52 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.001789 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3f771648-fd2b-4a90-bee2-96e054cbda52 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:31.017239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3f771648-fd2b-4a90-bee2-96e054cbda52 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.286306 Aug 31 00:22:31.018375 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 87/181] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:30 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:31.519520 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-fa7870dd-ab21-43cd-bf1a-a5e70f9d33bb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:31.520415 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-fa7870dd-ab21-43cd-bf1a-a5e70f9d33bb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:31.527292 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa7870dd-ab21-43cd-bf1a-a5e70f9d33bb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:31.527776 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa7870dd-ab21-43cd-bf1a-a5e70f9d33bb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:31.528247 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa7870dd-ab21-43cd-bf1a-a5e70f9d33bb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.529049 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa7870dd-ab21-43cd-bf1a-a5e70f9d33bb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:31.529512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa7870dd-ab21-43cd-bf1a-a5e70f9d33bb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:31.529972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa7870dd-ab21-43cd-bf1a-a5e70f9d33bb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.558634 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-fa7870dd-ab21-43cd-bf1a-a5e70f9d33bb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/ips" status: 200 len: 151 microversion: 2.20 time: 0.043751 Aug 31 00:22:31.559224 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 95/182] 10.222.0.47 () {60 vars in 1289 bytes} [Wed Aug 31 00:22:31 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:22:32.055225 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5626363b-8ea0-46b1-9e3a-22901dd5d5c7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:32.056346 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5626363b-8ea0-46b1-9e3a-22901dd5d5c7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:32.068754 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5626363b-8ea0-46b1-9e3a-22901dd5d5c7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:32.069733 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5626363b-8ea0-46b1-9e3a-22901dd5d5c7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:32.070470 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5626363b-8ea0-46b1-9e3a-22901dd5d5c7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:32.071319 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5626363b-8ea0-46b1-9e3a-22901dd5d5c7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:32.071830 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5626363b-8ea0-46b1-9e3a-22901dd5d5c7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:32.072376 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5626363b-8ea0-46b1-9e3a-22901dd5d5c7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:32.234171 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5626363b-8ea0-46b1-9e3a-22901dd5d5c7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:32.243673 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5626363b-8ea0-46b1-9e3a-22901dd5d5c7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.195364 Aug 31 00:22:32.244473 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 88/183] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:32 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:33.266888 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-08f45ef8-6301-4c13-acb7-b342f7f7e40e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:33.267594 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-08f45ef8-6301-4c13-acb7-b342f7f7e40e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:33.270420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=28 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:33.276961 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-08f45ef8-6301-4c13-acb7-b342f7f7e40e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:33.277448 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-08f45ef8-6301-4c13-acb7-b342f7f7e40e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:33.277997 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-08f45ef8-6301-4c13-acb7-b342f7f7e40e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:33.278804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-08f45ef8-6301-4c13-acb7-b342f7f7e40e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:33.279319 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-08f45ef8-6301-4c13-acb7-b342f7f7e40e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:33.279819 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-08f45ef8-6301-4c13-acb7-b342f7f7e40e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:33.440095 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-08f45ef8-6301-4c13-acb7-b342f7f7e40e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:33.449985 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-08f45ef8-6301-4c13-acb7-b342f7f7e40e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.186876 Aug 31 00:22:33.450586 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 96/184] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:33 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:34.316928 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8c8383c9-7db3-4452-858a-7f4d23fd053e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:34.319849 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=29 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:34.327124 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8c8383c9-7db3-4452-858a-7f4d23fd053e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.327626 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8c8383c9-7db3-4452-858a-7f4d23fd053e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.328064 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8c8383c9-7db3-4452-858a-7f4d23fd053e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.403644 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8c8383c9-7db3-4452-858a-7f4d23fd053e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Going to try to stop instance {{(pid=127117) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 00:22:34.473988 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2b56bdbd-45bd-4228-8f1c-df94babad29c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:34.474924 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2b56bdbd-45bd-4228-8f1c-df94babad29c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:34.482393 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b56bdbd-45bd-4228-8f1c-df94babad29c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.483322 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b56bdbd-45bd-4228-8f1c-df94babad29c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.484011 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b56bdbd-45bd-4228-8f1c-df94babad29c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.485030 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b56bdbd-45bd-4228-8f1c-df94babad29c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.486006 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b56bdbd-45bd-4228-8f1c-df94babad29c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.486747 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b56bdbd-45bd-4228-8f1c-df94babad29c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.627618 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8c8383c9-7db3-4452-858a-7f4d23fd053e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "POST /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/action" status: 202 len: 0 microversion: 2.1 time: 0.316145 Aug 31 00:22:34.629162 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 89/185] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:22:34 2022] POST /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:22:34.639092 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6e80e618-ba62-44f3-aebb-4bf5564f65b5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:34.640462 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6e80e618-ba62-44f3-aebb-4bf5564f65b5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:34.648907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e80e618-ba62-44f3-aebb-4bf5564f65b5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.649767 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e80e618-ba62-44f3-aebb-4bf5564f65b5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.650217 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e80e618-ba62-44f3-aebb-4bf5564f65b5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.650963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e80e618-ba62-44f3-aebb-4bf5564f65b5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.651421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e80e618-ba62-44f3-aebb-4bf5564f65b5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.651848 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e80e618-ba62-44f3-aebb-4bf5564f65b5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.796306 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2b56bdbd-45bd-4228-8f1c-df94babad29c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:34.812905 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2b56bdbd-45bd-4228-8f1c-df94babad29c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.344361 Aug 31 00:22:34.828191 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 97/186] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:34 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:34.828191 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-06e43114-2bb4-4dd4-baca-718ee1da9cfe tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:34.828191 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-06e43114-2bb4-4dd4-baca-718ee1da9cfe tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:34.839034 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06e43114-2bb4-4dd4-baca-718ee1da9cfe tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.840141 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06e43114-2bb4-4dd4-baca-718ee1da9cfe tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.841353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06e43114-2bb4-4dd4-baca-718ee1da9cfe tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.842912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06e43114-2bb4-4dd4-baca-718ee1da9cfe tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.844256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06e43114-2bb4-4dd4-baca-718ee1da9cfe tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.845508 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06e43114-2bb4-4dd4-baca-718ee1da9cfe tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.888618 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6e80e618-ba62-44f3-aebb-4bf5564f65b5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:34.898909 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6e80e618-ba62-44f3-aebb-4bf5564f65b5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.264319 Aug 31 00:22:34.899122 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 90/187] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:34 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:34.915724 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-06e43114-2bb4-4dd4-baca-718ee1da9cfe tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lazy-loading 'flavor' on Instance uuid e3a312d8-6cb2-4da8-a19b-215372294799 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:22:35.298538 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-06e43114-2bb4-4dd4-baca-718ee1da9cfe tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "POST /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/action" status: 202 len: 0 microversion: 2.20 time: 0.479656 Aug 31 00:22:35.300040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 98/188] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 31 00:22:34 2022] POST /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:22:35.315259 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:35.316996 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:35.349175 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.353485 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.354639 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.356114 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.357229 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.358174 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.686435 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:35.703886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:35.708788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:35.711159 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-32d195c2-7f63-43a4-acd7-fb7d1726de65 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.403985 Aug 31 00:22:35.712041 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 91/189] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:35 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:35.857776 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-051536c7-7e8c-4476-b642-341efae5aa01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:35.859159 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-051536c7-7e8c-4476-b642-341efae5aa01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:35.870276 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-051536c7-7e8c-4476-b642-341efae5aa01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.870929 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-051536c7-7e8c-4476-b642-341efae5aa01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.871512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-051536c7-7e8c-4476-b642-341efae5aa01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.872449 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-051536c7-7e8c-4476-b642-341efae5aa01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.873026 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-051536c7-7e8c-4476-b642-341efae5aa01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.873608 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-051536c7-7e8c-4476-b642-341efae5aa01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.928782 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4d188f37-8900-47cf-b82d-2b0d1ce94034 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:35.930304 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4d188f37-8900-47cf-b82d-2b0d1ce94034 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:35.940822 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d188f37-8900-47cf-b82d-2b0d1ce94034 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.941687 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d188f37-8900-47cf-b82d-2b0d1ce94034 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.942249 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d188f37-8900-47cf-b82d-2b0d1ce94034 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.943777 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d188f37-8900-47cf-b82d-2b0d1ce94034 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.944452 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d188f37-8900-47cf-b82d-2b0d1ce94034 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.945157 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d188f37-8900-47cf-b82d-2b0d1ce94034 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:36.238234 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-051536c7-7e8c-4476-b642-341efae5aa01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:36.254921 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4d188f37-8900-47cf-b82d-2b0d1ce94034 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:36.261420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-051536c7-7e8c-4476-b642-341efae5aa01 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.409616 Aug 31 00:22:36.264987 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 99/190] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:35 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:36.283698 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4d188f37-8900-47cf-b82d-2b0d1ce94034 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.362729 Aug 31 00:22:36.293665 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 92/191] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:35 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:36.743670 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:36.744721 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:36.751594 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:36.752079 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:36.753316 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:36.754081 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:36.754934 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:36.755368 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:36.955689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:36.986424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:36.991020 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:36.994386 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-61ae9e46-3221-4790-b78b-c723fa70bddf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.254870 Aug 31 00:22:36.995768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 100/192] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:36 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:37.298232 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-0ccbcd78-e916-4b0d-af52-9711dfc49ac8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:37.299267 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-0ccbcd78-e916-4b0d-af52-9711dfc49ac8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:37.309207 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ccbcd78-e916-4b0d-af52-9711dfc49ac8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:37.309905 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ccbcd78-e916-4b0d-af52-9711dfc49ac8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:37.310486 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ccbcd78-e916-4b0d-af52-9711dfc49ac8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:37.311730 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ccbcd78-e916-4b0d-af52-9711dfc49ac8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:37.312444 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ccbcd78-e916-4b0d-af52-9711dfc49ac8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:37.313636 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ccbcd78-e916-4b0d-af52-9711dfc49ac8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:37.314200 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-6d249148-a761-47c0-8a7f-9395b4ae2df7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:37.315163 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-6d249148-a761-47c0-8a7f-9395b4ae2df7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:37.327958 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6d249148-a761-47c0-8a7f-9395b4ae2df7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:37.329475 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6d249148-a761-47c0-8a7f-9395b4ae2df7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:37.330297 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6d249148-a761-47c0-8a7f-9395b4ae2df7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:37.332855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6d249148-a761-47c0-8a7f-9395b4ae2df7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:37.333533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6d249148-a761-47c0-8a7f-9395b4ae2df7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:37.334248 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6d249148-a761-47c0-8a7f-9395b4ae2df7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:37.589437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-0ccbcd78-e916-4b0d-af52-9711dfc49ac8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:37.593377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:37.606212 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-6d249148-a761-47c0-8a7f-9395b4ae2df7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:37.606708 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-0ccbcd78-e916-4b0d-af52-9711dfc49ac8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.312882 Aug 31 00:22:37.608064 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 93/193] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:37 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:37.624545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-6d249148-a761-47c0-8a7f-9395b4ae2df7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.317992 Aug 31 00:22:37.626199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 101/194] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:37 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:38.029123 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:38.030212 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:38.040255 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:38.040754 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:38.041183 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:38.041905 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:38.042368 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:38.042786 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:38.220899 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:38.232682 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:38.234498 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:38.236016 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e7080a43-6d2d-466b-82df-195d2f42cecb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.214738 Aug 31 00:22:38.236697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 94/195] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:38 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:38.640515 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4fc86105-cbe7-4212-bf9a-98834fbe747a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:38.641277 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4fc86105-cbe7-4212-bf9a-98834fbe747a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:38.653787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4fc86105-cbe7-4212-bf9a-98834fbe747a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:38.657594 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4fc86105-cbe7-4212-bf9a-98834fbe747a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:38.658559 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4fc86105-cbe7-4212-bf9a-98834fbe747a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:38.660788 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4fc86105-cbe7-4212-bf9a-98834fbe747a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:38.661644 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4fc86105-cbe7-4212-bf9a-98834fbe747a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:38.662461 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4fc86105-cbe7-4212-bf9a-98834fbe747a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:38.667983 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ac1f13b1-6c89-4198-a33b-cf3b9181a91a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:38.677418 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ac1f13b1-6c89-4198-a33b-cf3b9181a91a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:38.688306 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac1f13b1-6c89-4198-a33b-cf3b9181a91a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:38.696729 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac1f13b1-6c89-4198-a33b-cf3b9181a91a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:38.699292 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac1f13b1-6c89-4198-a33b-cf3b9181a91a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:38.701129 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac1f13b1-6c89-4198-a33b-cf3b9181a91a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:38.702086 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac1f13b1-6c89-4198-a33b-cf3b9181a91a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:38.703120 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac1f13b1-6c89-4198-a33b-cf3b9181a91a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:38.933218 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4fc86105-cbe7-4212-bf9a-98834fbe747a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:38.949018 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4fc86105-cbe7-4212-bf9a-98834fbe747a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.318457 Aug 31 00:22:38.950049 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 102/196] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:38 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:38.979790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ac1f13b1-6c89-4198-a33b-cf3b9181a91a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:38.995219 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ac1f13b1-6c89-4198-a33b-cf3b9181a91a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.335461 Aug 31 00:22:38.996119 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 95/197] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:38 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:39.261655 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:39.262173 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:39.269438 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:39.270504 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:39.270940 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:39.271667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:39.272119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:39.272578 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:39.457648 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:39.466670 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:39.468133 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:39.469356 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e5d3858c-8cef-4096-93a8-892d37f03d22 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.211914 Aug 31 00:22:39.469931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 103/198] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:39 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:39.984729 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-62c21134-b114-4b94-ab14-c6699a43757e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:39.985683 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-62c21134-b114-4b94-ab14-c6699a43757e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:39.998913 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62c21134-b114-4b94-ab14-c6699a43757e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:39.999784 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62c21134-b114-4b94-ab14-c6699a43757e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.000801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62c21134-b114-4b94-ab14-c6699a43757e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.002198 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62c21134-b114-4b94-ab14-c6699a43757e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:40.003565 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62c21134-b114-4b94-ab14-c6699a43757e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.004651 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-62c21134-b114-4b94-ab14-c6699a43757e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.025152 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9e20c744-2b4f-44db-bd24-e8d8b28d32ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:40.026087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9e20c744-2b4f-44db-bd24-e8d8b28d32ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:40.032734 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9e20c744-2b4f-44db-bd24-e8d8b28d32ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:40.033238 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9e20c744-2b4f-44db-bd24-e8d8b28d32ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.033764 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9e20c744-2b4f-44db-bd24-e8d8b28d32ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.034655 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9e20c744-2b4f-44db-bd24-e8d8b28d32ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:40.035393 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9e20c744-2b4f-44db-bd24-e8d8b28d32ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.035829 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9e20c744-2b4f-44db-bd24-e8d8b28d32ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.252436 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-62c21134-b114-4b94-ab14-c6699a43757e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:40.258901 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9e20c744-2b4f-44db-bd24-e8d8b28d32ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:40.267347 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-62c21134-b114-4b94-ab14-c6699a43757e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.288103 Aug 31 00:22:40.268461 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 96/199] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:39 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:40.275156 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9e20c744-2b4f-44db-bd24-e8d8b28d32ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.253798 Aug 31 00:22:40.276242 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 104/200] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:40 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:40.497356 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:40.498452 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:40.511004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:40.512220 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.513015 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.514051 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:40.514771 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.515404 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.685408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:40.695452 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:40.696978 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:40.698197 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6de407f5-962b-49b5-b9e2-cbcb267b61d6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.208621 Aug 31 00:22:40.698761 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 97/201] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:40 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:41.305509 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-838bf1a7-e00c-4f22-b3e0-25146a8de3d2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:41.323109 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-70373a87-f101-4575-9d9b-6725ccf36145 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:41.328338 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-838bf1a7-e00c-4f22-b3e0-25146a8de3d2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:41.330860 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-70373a87-f101-4575-9d9b-6725ccf36145 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:41.353819 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70373a87-f101-4575-9d9b-6725ccf36145 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.354325 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70373a87-f101-4575-9d9b-6725ccf36145 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.354758 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70373a87-f101-4575-9d9b-6725ccf36145 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.356415 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-838bf1a7-e00c-4f22-b3e0-25146a8de3d2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.357169 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-838bf1a7-e00c-4f22-b3e0-25146a8de3d2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.357611 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-838bf1a7-e00c-4f22-b3e0-25146a8de3d2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.358346 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-838bf1a7-e00c-4f22-b3e0-25146a8de3d2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.358802 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-838bf1a7-e00c-4f22-b3e0-25146a8de3d2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.359362 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-838bf1a7-e00c-4f22-b3e0-25146a8de3d2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.361002 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70373a87-f101-4575-9d9b-6725ccf36145 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.361469 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70373a87-f101-4575-9d9b-6725ccf36145 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.362127 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70373a87-f101-4575-9d9b-6725ccf36145 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.690359 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-70373a87-f101-4575-9d9b-6725ccf36145 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:41.701109 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-70373a87-f101-4575-9d9b-6725ccf36145 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.390764 Aug 31 00:22:41.701823 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 98/202] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:41 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:41.729610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:41.730236 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:41.740369 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.741463 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.742150 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.742927 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.743396 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.743870 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.782024 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-838bf1a7-e00c-4f22-b3e0-25146a8de3d2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:41.804657 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-838bf1a7-e00c-4f22-b3e0-25146a8de3d2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.510015 Aug 31 00:22:41.805849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 105/203] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:41 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:42.010074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:42.019719 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:42.021400 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:42.022616 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c4c247e9-d2a6-451d-bdf9-98a72918b9e9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.298880 Aug 31 00:22:42.023523 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 99/204] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:41 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:42.731300 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2967dddb-95fb-43eb-8343-f617130b442e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:42.732625 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2967dddb-95fb-43eb-8343-f617130b442e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:42.743962 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2967dddb-95fb-43eb-8343-f617130b442e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.744830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2967dddb-95fb-43eb-8343-f617130b442e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.745457 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2967dddb-95fb-43eb-8343-f617130b442e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:42.746212 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2967dddb-95fb-43eb-8343-f617130b442e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.746668 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2967dddb-95fb-43eb-8343-f617130b442e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.747266 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2967dddb-95fb-43eb-8343-f617130b442e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:42.842346 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ac6d2a25-154b-4712-b988-19781f2cb654 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:42.843273 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ac6d2a25-154b-4712-b988-19781f2cb654 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:42.852240 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac6d2a25-154b-4712-b988-19781f2cb654 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.853088 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac6d2a25-154b-4712-b988-19781f2cb654 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.853711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac6d2a25-154b-4712-b988-19781f2cb654 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:42.854551 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac6d2a25-154b-4712-b988-19781f2cb654 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.855272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac6d2a25-154b-4712-b988-19781f2cb654 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.856082 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac6d2a25-154b-4712-b988-19781f2cb654 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:43.285613 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2967dddb-95fb-43eb-8343-f617130b442e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.297943 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2967dddb-95fb-43eb-8343-f617130b442e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.576108 Aug 31 00:22:43.298851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 106/205] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:42 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:43.308474 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:43.310155 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:43.318637 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ac6d2a25-154b-4712-b988-19781f2cb654 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.336856 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:43.337513 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ac6d2a25-154b-4712-b988-19781f2cb654 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.499700 Aug 31 00:22:43.337686 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:43.338393 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:43.339105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 100/206] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:42 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:43.339601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:43.340143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:43.340808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:43.502902 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.512529 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.514055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.515299 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-dc064fc4-5b47-40b4-90b4-2fcff9c552d0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.214780 Aug 31 00:22:43.516127 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 107/207] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:43 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:44.340146 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4235d48f-c6b1-48a5-b5a4-644da717fb1e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:44.341550 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4235d48f-c6b1-48a5-b5a4-644da717fb1e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:44.353775 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4235d48f-c6b1-48a5-b5a4-644da717fb1e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.354666 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4235d48f-c6b1-48a5-b5a4-644da717fb1e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.355475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4235d48f-c6b1-48a5-b5a4-644da717fb1e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.356814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4235d48f-c6b1-48a5-b5a4-644da717fb1e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.357673 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4235d48f-c6b1-48a5-b5a4-644da717fb1e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.358480 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4235d48f-c6b1-48a5-b5a4-644da717fb1e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.361286 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-cbdff037-d9e3-461f-93e2-9b59e90b37a2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:44.361929 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-cbdff037-d9e3-461f-93e2-9b59e90b37a2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:44.368869 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cbdff037-d9e3-461f-93e2-9b59e90b37a2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.369522 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cbdff037-d9e3-461f-93e2-9b59e90b37a2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.370024 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cbdff037-d9e3-461f-93e2-9b59e90b37a2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.370754 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cbdff037-d9e3-461f-93e2-9b59e90b37a2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.371197 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cbdff037-d9e3-461f-93e2-9b59e90b37a2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.371617 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cbdff037-d9e3-461f-93e2-9b59e90b37a2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.389131 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:44.597954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-cbdff037-d9e3-461f-93e2-9b59e90b37a2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.606376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-cbdff037-d9e3-461f-93e2-9b59e90b37a2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.248769 Aug 31 00:22:44.608880 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 108/208] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:44 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:44.613728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4235d48f-c6b1-48a5-b5a4-644da717fb1e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.614653 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:44.615271 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:44.622129 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.622630 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.623072 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.623792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.624285 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.624715 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.626010 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4235d48f-c6b1-48a5-b5a4-644da717fb1e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.293472 Aug 31 00:22:44.626732 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 101/209] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:44 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:44.799199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.809910 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.811453 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.812724 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3bcbdde8-8c49-4e06-b65d-5a4b9984854a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.202800 Aug 31 00:22:44.813387 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 109/210] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:44 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:45.631081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-34efde2c-d711-469b-866e-8488148b5a1b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:45.632093 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-34efde2c-d711-469b-866e-8488148b5a1b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:45.644054 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34efde2c-d711-469b-866e-8488148b5a1b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.645297 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34efde2c-d711-469b-866e-8488148b5a1b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.646016 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34efde2c-d711-469b-866e-8488148b5a1b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.647221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34efde2c-d711-469b-866e-8488148b5a1b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.647985 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34efde2c-d711-469b-866e-8488148b5a1b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.648723 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34efde2c-d711-469b-866e-8488148b5a1b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.653377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-504ab7c2-da57-446a-aa57-8702bb0648d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:45.654691 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-504ab7c2-da57-446a-aa57-8702bb0648d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:45.666208 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-504ab7c2-da57-446a-aa57-8702bb0648d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.667235 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-504ab7c2-da57-446a-aa57-8702bb0648d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.668063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-504ab7c2-da57-446a-aa57-8702bb0648d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.669108 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-504ab7c2-da57-446a-aa57-8702bb0648d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.670143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-504ab7c2-da57-446a-aa57-8702bb0648d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.671169 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-504ab7c2-da57-446a-aa57-8702bb0648d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.012758 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-34efde2c-d711-469b-866e-8488148b5a1b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.014064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-504ab7c2-da57-446a-aa57-8702bb0648d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.023288 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-34efde2c-d711-469b-866e-8488148b5a1b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1499 microversion: 2.1 time: 0.398700 Aug 31 00:22:46.023777 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-504ab7c2-da57-446a-aa57-8702bb0648d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.377639 Aug 31 00:22:46.024212 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 102/211] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:45 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1499 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:46.024974 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 110/212] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:45 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:46.033973 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:46.035153 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:46.047436 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.048527 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.049338 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.050689 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.051490 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.052290 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.062091 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfb85eba-b198-4ce4-9677-a6a4c0013053"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:46.066837 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:46.077109 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.077948 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.078767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.079875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.080599 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.081992 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.119851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] HTTP exception thrown: Cannot 'attach_volume' instance 379d25b6-01b5-4bed-ba25-2f169d66600b while it is in vm_state rescued Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Request method failure captured: Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: POST /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b/os-volume_attachments HTTP/1.1 Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 74 Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYalK_ZiTauZ-9XDO7haKEIuXnKbHhABMonOFQP-rI78FINZ2XVrTy8p1zk3RjEkVar9pkgMdmtZNVYMAs-uZPoCRzB4Th807o4TLWVOTd_MNqGbppsFiV6_vn3vGaC-JcYOQFNXv-OJkCGApOtlB6lTEq6yiN8b9AAW0Sat2RBB8 Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: af873e6a013c457aa2407fb24423ddc1 Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:22:46.121941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_af873e6a013c457aa2407fb24423ddc1"}]}] Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: af873e6a013c457aa2407fb24423ddc1 Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-ServerRescueNegativeTestJSON-1960179446-project Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: f8ffd2d3c0c141118a7a9a5696c383e1 Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1960179446-project Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {"volumeAttachment": {"volumeId": "bfb85eba-b198-4ce4-9677-a6a4c0013053"}} Aug 31 00:22:46.124779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Cannot 'attach_volume' instance 379d25b6-01b5-4bed-ba25-2f169d66600b while it is in vm_state rescued Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'server_id': '379d25b6-01b5-4bed-ba25-2f169d66600b', 'body': {'volumeAttachment': {'volumeId': 'bfb85eba-b198-4ce4-9677-a6a4c0013053'}}} Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 379d25b6-01b5-4bed-ba25-2f169d66600b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:22:46.126140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 379d25b6-01b5-4bed-ba25-2f169d66600b while it is in vm_state rescued Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:46.127546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:46.129921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:22:46.129921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:22:46.129921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 379d25b6-01b5-4bed-ba25-2f169d66600b while it is in vm_state rescued Aug 31 00:22:46.129921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:22:46.129921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Returning 409 to user: Cannot 'attach_volume' instance 379d25b6-01b5-4bed-ba25-2f169d66600b while it is in vm_state rescued {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:22:46.129921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8d253e57-f397-4553-bf24-1625ddc78c23 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "POST /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.068539 Aug 31 00:22:46.129921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 111/213] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:22:46 2022] POST /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b/os-volume_attachments => generated 152 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 00:22:46.138746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7f50408c-ad0c-494e-b91d-6f151acd89fa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:46.139976 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7f50408c-ad0c-494e-b91d-6f151acd89fa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:46.153968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7f50408c-ad0c-494e-b91d-6f151acd89fa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.153968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7f50408c-ad0c-494e-b91d-6f151acd89fa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.154921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7f50408c-ad0c-494e-b91d-6f151acd89fa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.156282 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7f50408c-ad0c-494e-b91d-6f151acd89fa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.157146 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7f50408c-ad0c-494e-b91d-6f151acd89fa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.158191 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7f50408c-ad0c-494e-b91d-6f151acd89fa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.250487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.250735 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7f50408c-ad0c-494e-b91d-6f151acd89fa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "POST /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b/action" status: 202 len: 0 microversion: 2.1 time: 0.117339 Aug 31 00:22:46.251173 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 112/214] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:22:46 2022] POST /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:22:46.262755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-85563b27-b824-46d5-a464-8097520f991c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:46.263841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-85563b27-b824-46d5-a464-8097520f991c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:46.272508 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.277279 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.278779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-85563b27-b824-46d5-a464-8097520f991c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.278779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-85563b27-b824-46d5-a464-8097520f991c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.279167 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-85563b27-b824-46d5-a464-8097520f991c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.282470 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2d90d106-9788-4e3f-9dfa-547fdcd65666 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.252738 Aug 31 00:22:46.282849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-85563b27-b824-46d5-a464-8097520f991c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.282849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-85563b27-b824-46d5-a464-8097520f991c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.282849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-85563b27-b824-46d5-a464-8097520f991c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.283400 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 103/215] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:46 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:46.555472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-85563b27-b824-46d5-a464-8097520f991c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.571979 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-85563b27-b824-46d5-a464-8097520f991c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1507 microversion: 2.1 time: 0.313346 Aug 31 00:22:46.573347 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 113/216] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:46 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:46.976136 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e172b54e-ffda-49a7-98fe-c6a8d1383a5b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:46.984839 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e172b54e-ffda-49a7-98fe-c6a8d1383a5b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:47.033197 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e172b54e-ffda-49a7-98fe-c6a8d1383a5b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.034961 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e172b54e-ffda-49a7-98fe-c6a8d1383a5b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.038295 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e172b54e-ffda-49a7-98fe-c6a8d1383a5b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.040448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e172b54e-ffda-49a7-98fe-c6a8d1383a5b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.041921 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e172b54e-ffda-49a7-98fe-c6a8d1383a5b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.046758 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e172b54e-ffda-49a7-98fe-c6a8d1383a5b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.064188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f92e169b-227e-4df6-9365-93bdf6f0b407 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:47.067051 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f92e169b-227e-4df6-9365-93bdf6f0b407 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:47.120885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92e169b-227e-4df6-9365-93bdf6f0b407 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.129387 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92e169b-227e-4df6-9365-93bdf6f0b407 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.130311 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92e169b-227e-4df6-9365-93bdf6f0b407 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.131841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92e169b-227e-4df6-9365-93bdf6f0b407 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.132814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92e169b-227e-4df6-9365-93bdf6f0b407 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.133686 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92e169b-227e-4df6-9365-93bdf6f0b407 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.148882 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e172b54e-ffda-49a7-98fe-c6a8d1383a5b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/ips" status: 200 len: 151 microversion: 2.1 time: 0.172599 Aug 31 00:22:47.150631 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 104/217] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 31 00:22:46 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/ips => generated 151 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:47.320583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:47.321648 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:47.357801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.359223 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.360236 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.363911 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.372431 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.374057 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.523532 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f92e169b-227e-4df6-9365-93bdf6f0b407 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:47.545495 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f92e169b-227e-4df6-9365-93bdf6f0b407 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.488685 Aug 31 00:22:47.569427 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 114/218] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:47 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:47.610092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-06f47d0d-ebea-4852-a1e4-9199082a63fb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:47.611140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-06f47d0d-ebea-4852-a1e4-9199082a63fb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:47.624731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06f47d0d-ebea-4852-a1e4-9199082a63fb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.625624 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06f47d0d-ebea-4852-a1e4-9199082a63fb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.626411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06f47d0d-ebea-4852-a1e4-9199082a63fb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.628563 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06f47d0d-ebea-4852-a1e4-9199082a63fb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.629003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06f47d0d-ebea-4852-a1e4-9199082a63fb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.629738 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-06f47d0d-ebea-4852-a1e4-9199082a63fb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.842621 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:47.883712 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:47.908927 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:47.915494 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7f92d99a-99af-4d7d-acd9-c7e3e5f45cc6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.603949 Aug 31 00:22:47.916662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 105/219] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:47 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:48.001035 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-06f47d0d-ebea-4852-a1e4-9199082a63fb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:48.017856 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-06f47d0d-ebea-4852-a1e4-9199082a63fb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1507 microversion: 2.1 time: 0.413932 Aug 31 00:22:48.019925 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 115/220] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:47 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:48.592005 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6485925e-56f1-4178-ae45-983509fba4ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:48.593078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6485925e-56f1-4178-ae45-983509fba4ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:48.605526 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6485925e-56f1-4178-ae45-983509fba4ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.606344 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6485925e-56f1-4178-ae45-983509fba4ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.607401 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6485925e-56f1-4178-ae45-983509fba4ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.608672 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6485925e-56f1-4178-ae45-983509fba4ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.609477 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6485925e-56f1-4178-ae45-983509fba4ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.610501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6485925e-56f1-4178-ae45-983509fba4ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.899498 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6485925e-56f1-4178-ae45-983509fba4ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:48.915542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6485925e-56f1-4178-ae45-983509fba4ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.330386 Aug 31 00:22:48.917068 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 106/221] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:48 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:48.945180 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:48.947945 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:48.962901 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.963610 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.964404 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.965817 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.966595 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.967500 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.066698 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-88a13c5d-f511-4a39-8aba-84e43f932ba5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:49.066698 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-88a13c5d-f511-4a39-8aba-84e43f932ba5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:49.077207 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-88a13c5d-f511-4a39-8aba-84e43f932ba5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.078286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-88a13c5d-f511-4a39-8aba-84e43f932ba5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.079096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-88a13c5d-f511-4a39-8aba-84e43f932ba5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.080534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-88a13c5d-f511-4a39-8aba-84e43f932ba5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.082043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-88a13c5d-f511-4a39-8aba-84e43f932ba5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.082918 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-88a13c5d-f511-4a39-8aba-84e43f932ba5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.404383 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:49.423607 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:49.426770 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:49.429271 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1a284d56-0dfc-4246-ae40-dbdb324e59e5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.490165 Aug 31 00:22:49.440796 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 116/222] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:48 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:49.452649 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1c0f6e79-1854-49d5-b437-8b55a455d87c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:49.459181 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1c0f6e79-1854-49d5-b437-8b55a455d87c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:49.473242 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1c0f6e79-1854-49d5-b437-8b55a455d87c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.474015 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1c0f6e79-1854-49d5-b437-8b55a455d87c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.474733 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1c0f6e79-1854-49d5-b437-8b55a455d87c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.475937 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1c0f6e79-1854-49d5-b437-8b55a455d87c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.476778 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1c0f6e79-1854-49d5-b437-8b55a455d87c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.477707 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1c0f6e79-1854-49d5-b437-8b55a455d87c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.482036 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-88a13c5d-f511-4a39-8aba-84e43f932ba5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:49.495013 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-88a13c5d-f511-4a39-8aba-84e43f932ba5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1507 microversion: 2.1 time: 0.439645 Aug 31 00:22:49.496849 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 107/223] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:49 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1507 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:49.964821 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8e177e14-35f8-4ec7-8602-f90f753904d2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:49.970973 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8e177e14-35f8-4ec7-8602-f90f753904d2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:49.997658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e177e14-35f8-4ec7-8602-f90f753904d2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.000658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e177e14-35f8-4ec7-8602-f90f753904d2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.001395 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e177e14-35f8-4ec7-8602-f90f753904d2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.002526 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e177e14-35f8-4ec7-8602-f90f753904d2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.003921 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e177e14-35f8-4ec7-8602-f90f753904d2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.010139 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e177e14-35f8-4ec7-8602-f90f753904d2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.280321 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8e177e14-35f8-4ec7-8602-f90f753904d2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:50.298286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8e177e14-35f8-4ec7-8602-f90f753904d2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.349030 Aug 31 00:22:50.300188 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 108/224] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:49 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:50.469091 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:50.470134 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:50.489007 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.490199 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.490961 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.492212 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.493265 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.494229 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.791907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:50.813961 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:50.818971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:50.822965 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9ec95337-9e4a-4620-b394-97eb669a536f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.358546 Aug 31 00:22:50.832769 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 109/225] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:50 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:50.843462 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f764b447-bf8d-452f-a544-b66876955e53 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:50.845033 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f764b447-bf8d-452f-a544-b66876955e53 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:50.861761 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f764b447-bf8d-452f-a544-b66876955e53 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.864329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f764b447-bf8d-452f-a544-b66876955e53 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.865566 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f764b447-bf8d-452f-a544-b66876955e53 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.867264 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f764b447-bf8d-452f-a544-b66876955e53 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.868578 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f764b447-bf8d-452f-a544-b66876955e53 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.869682 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f764b447-bf8d-452f-a544-b66876955e53 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.156036 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f764b447-bf8d-452f-a544-b66876955e53 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:51.159841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=100 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:51.175501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f764b447-bf8d-452f-a544-b66876955e53 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1507 microversion: 2.1 time: 0.338080 Aug 31 00:22:51.177218 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 110/226] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:50 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:51.331059 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-becb68ae-de10-4ed0-98bf-f53f69c1d8b8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:51.331816 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-becb68ae-de10-4ed0-98bf-f53f69c1d8b8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:51.339323 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-becb68ae-de10-4ed0-98bf-f53f69c1d8b8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.340447 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-becb68ae-de10-4ed0-98bf-f53f69c1d8b8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.341105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-becb68ae-de10-4ed0-98bf-f53f69c1d8b8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.342272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-becb68ae-de10-4ed0-98bf-f53f69c1d8b8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.350563 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-becb68ae-de10-4ed0-98bf-f53f69c1d8b8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.351279 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-becb68ae-de10-4ed0-98bf-f53f69c1d8b8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.604569 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-becb68ae-de10-4ed0-98bf-f53f69c1d8b8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:51.622509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-becb68ae-de10-4ed0-98bf-f53f69c1d8b8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.298614 Aug 31 00:22:51.624695 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 111/227] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:51 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:51.881085 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:51.883000 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:51.894424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.895589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.896206 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.897216 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.897827 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.898460 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.153221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:52.170740 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:52.173661 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:52.177202 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5c310b72-e50f-4066-9c71-ec8b5f6369a7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.301144 Aug 31 00:22:52.178202 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 112/228] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:51 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:52.209428 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-262edcee-879e-41b0-a5da-7bf1412d9122 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:52.210228 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-262edcee-879e-41b0-a5da-7bf1412d9122 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:52.218811 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-262edcee-879e-41b0-a5da-7bf1412d9122 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.219557 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-262edcee-879e-41b0-a5da-7bf1412d9122 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.220402 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-262edcee-879e-41b0-a5da-7bf1412d9122 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.221962 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-262edcee-879e-41b0-a5da-7bf1412d9122 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.222632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-262edcee-879e-41b0-a5da-7bf1412d9122 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.223207 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-262edcee-879e-41b0-a5da-7bf1412d9122 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.430087 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-262edcee-879e-41b0-a5da-7bf1412d9122 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:52.439163 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-262edcee-879e-41b0-a5da-7bf1412d9122 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1513 microversion: 2.1 time: 0.235313 Aug 31 00:22:52.439879 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 113/229] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:52 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:52.656720 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-160a5824-a5bc-45e6-8e66-688c2892ea2f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:52.657858 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-160a5824-a5bc-45e6-8e66-688c2892ea2f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:52.670609 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-160a5824-a5bc-45e6-8e66-688c2892ea2f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.671512 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-160a5824-a5bc-45e6-8e66-688c2892ea2f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.672516 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-160a5824-a5bc-45e6-8e66-688c2892ea2f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.674111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-160a5824-a5bc-45e6-8e66-688c2892ea2f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.676096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-160a5824-a5bc-45e6-8e66-688c2892ea2f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.677272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-160a5824-a5bc-45e6-8e66-688c2892ea2f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.006020 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-160a5824-a5bc-45e6-8e66-688c2892ea2f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:53.032982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-160a5824-a5bc-45e6-8e66-688c2892ea2f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.380783 Aug 31 00:22:53.036445 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 114/230] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:52 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:53.045641 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1647631933", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "networks": [{"uuid": "fc7bd654-7a6a-455d-b9c1-26e1fa3e9adb"}]}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:53.116593 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] validate_networks() for [('fc7bd654-7a6a-455d-b9c1-26e1fa3e9adb', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:22:53.179004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1c0f6e79-1854-49d5-b437-8b55a455d87c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.735394 Aug 31 00:22:53.180134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 117/231] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:22:49 2022] POST /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-volume_attachments => generated 194 bytes in 3738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:53.223750 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:53.225405 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:53.239427 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.240281 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.241598 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.243239 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.244337 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.245267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.638955 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:53.649643 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:53.651723 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:53.653056 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b37d263b-4b3a-4c41-bf34-21bd4baf5267 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.437842 Aug 31 00:22:53.669212 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 118/232] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:53 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:53.828304 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:22:53.829440 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:22:53.830273 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:22:53.831420 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:22:53.832252 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:22:53.844435 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.845055 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.845812 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.847259 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.847951 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.848808 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.880340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Getting quotas for project 29f449e37cc6482eaca34671c7541c4b. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:22:53.887765 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Getting quotas for user c9dd5782e5f84ed68282cdda78ce909f and project 29f449e37cc6482eaca34671c7541c4b. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:22:53.908577 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:22:53.908913 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:22:53.976644 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2b8e56cc-585e-441d-bdea-37e33105d2aa tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938641 Aug 31 00:22:53.977729 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 115/233] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:22:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:22:53.998476 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-bb6bf646-1b29-47cd-adb5-13dc6a4fce08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:53.999719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-bb6bf646-1b29-47cd-adb5-13dc6a4fce08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:54.076828 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4ab9b36c-d50a-4095-8bf1-553ebe02926f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:54.077789 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4ab9b36c-d50a-4095-8bf1-553ebe02926f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:54.089539 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-bb6bf646-1b29-47cd-adb5-13dc6a4fce08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:54.098369 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-bb6bf646-1b29-47cd-adb5-13dc6a4fce08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1219 microversion: 2.1 time: 0.108573 Aug 31 00:22:54.099297 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 119/234] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:53 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:54.100354 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4ab9b36c-d50a-4095-8bf1-553ebe02926f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.100820 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4ab9b36c-d50a-4095-8bf1-553ebe02926f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.101271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4ab9b36c-d50a-4095-8bf1-553ebe02926f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.102125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4ab9b36c-d50a-4095-8bf1-553ebe02926f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.102467 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4ab9b36c-d50a-4095-8bf1-553ebe02926f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.102911 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4ab9b36c-d50a-4095-8bf1-553ebe02926f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.354014 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4ab9b36c-d50a-4095-8bf1-553ebe02926f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:54.367353 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4ab9b36c-d50a-4095-8bf1-553ebe02926f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1721 microversion: 2.1 time: 0.299512 Aug 31 00:22:54.368624 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 116/235] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:54 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:54.377092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0d7a9766-894b-4b27-a564-e0cbff0e181b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Action: 'create', calling method: .version_select at 0x7f1a3ab9f160>, body: {"keypair": {"name": "tempest-keypair-747050452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkQRKfDkbU+UOUvZ4Omsobadoac9Ej9goX0EsL4WGT8ZmUHo+cKEKML4yaQI09v0N59tXWfxlis7cN3g8ZSxWY6xTE+R7J/J6NahcQYfSaQ3JG2lJOMgcHJPD4r3w1J2Q=="}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:54.429802 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-0d7a9766-894b-4b27-a564-e0cbff0e181b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Getting quotas for project af873e6a013c457aa2407fb24423ddc1. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:22:54.439856 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-0d7a9766-894b-4b27-a564-e0cbff0e181b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Getting quotas for user f8ffd2d3c0c141118a7a9a5696c383e1 and project af873e6a013c457aa2407fb24423ddc1. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:22:54.483284 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0d7a9766-894b-4b27-a564-e0cbff0e181b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110009 Aug 31 00:22:54.485061 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 120/236] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 31 00:22:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:54.685982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:54.699208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:54.725947 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.727189 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.728460 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.729624 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.730334 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.730916 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.100143 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.111468 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.114103 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.115862 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6525407e-9a67-4635-abf9-2bd60a15cea7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.439558 Aug 31 00:22:55.116605 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 117/237] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:54 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:55.140988 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-610cf85e-0ec2-4b8d-b8b5-b42f955e5bf0 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:55.142147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-610cf85e-0ec2-4b8d-b8b5-b42f955e5bf0 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:55.152054 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-610cf85e-0ec2-4b8d-b8b5-b42f955e5bf0 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.153024 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-610cf85e-0ec2-4b8d-b8b5-b42f955e5bf0 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.154002 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-610cf85e-0ec2-4b8d-b8b5-b42f955e5bf0 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.155020 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-610cf85e-0ec2-4b8d-b8b5-b42f955e5bf0 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.155902 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-610cf85e-0ec2-4b8d-b8b5-b42f955e5bf0 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.156665 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-610cf85e-0ec2-4b8d-b8b5-b42f955e5bf0 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.305531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-610cf85e-0ec2-4b8d-b8b5-b42f955e5bf0 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.323967 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-610cf85e-0ec2-4b8d-b8b5-b42f955e5bf0 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1215 microversion: 2.1 time: 0.192791 Aug 31 00:22:55.327583 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 121/238] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:55 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1215 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:55.409715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1fd568fb-f0ed-44e8-8038-d0c266408c72 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:55.410729 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1fd568fb-f0ed-44e8-8038-d0c266408c72 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:55.418162 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1fd568fb-f0ed-44e8-8038-d0c266408c72 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.418700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1fd568fb-f0ed-44e8-8038-d0c266408c72 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.419204 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1fd568fb-f0ed-44e8-8038-d0c266408c72 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.419970 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1fd568fb-f0ed-44e8-8038-d0c266408c72 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.420670 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1fd568fb-f0ed-44e8-8038-d0c266408c72 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.421105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1fd568fb-f0ed-44e8-8038-d0c266408c72 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.688743 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1fd568fb-f0ed-44e8-8038-d0c266408c72 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.699471 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1fd568fb-f0ed-44e8-8038-d0c266408c72 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1698 microversion: 2.1 time: 0.293631 Aug 31 00:22:55.700211 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 118/239] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:55 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1698 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:55.738911 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-56035c13-7a7a-4344-882d-295ec1af33ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:55.753259 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-56035c13-7a7a-4344-882d-295ec1af33ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.754134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-56035c13-7a7a-4344-882d-295ec1af33ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.755441 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-56035c13-7a7a-4344-882d-295ec1af33ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.891345 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-56035c13-7a7a-4344-882d-295ec1af33ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Going to try to start instance {{(pid=127118) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 00:22:55.995992 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-56035c13-7a7a-4344-882d-295ec1af33ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "POST /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/action" status: 202 len: 0 microversion: 2.1 time: 0.264084 Aug 31 00:22:56.008759 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 122/240] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:22:55 2022] POST /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:22:56.014405 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1df570ed-9c81-4f08-afa7-963a52bc7ec9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:56.015301 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1df570ed-9c81-4f08-afa7-963a52bc7ec9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:56.035528 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1df570ed-9c81-4f08-afa7-963a52bc7ec9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.041134 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1df570ed-9c81-4f08-afa7-963a52bc7ec9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.043215 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1df570ed-9c81-4f08-afa7-963a52bc7ec9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.044872 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1df570ed-9c81-4f08-afa7-963a52bc7ec9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.045698 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1df570ed-9c81-4f08-afa7-963a52bc7ec9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.046437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1df570ed-9c81-4f08-afa7-963a52bc7ec9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.160820 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:56.162560 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:56.181590 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.183051 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.184837 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.187738 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.190918 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.192550 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.418576 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1df570ed-9c81-4f08-afa7-963a52bc7ec9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.432979 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1df570ed-9c81-4f08-afa7-963a52bc7ec9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1707 microversion: 2.1 time: 0.423249 Aug 31 00:22:56.433600 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 119/241] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:56 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1707 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:56.447331 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-eae0a2f4-fb03-4211-8d89-33fb794038da tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:56.447949 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-eae0a2f4-fb03-4211-8d89-33fb794038da tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:56.464364 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eae0a2f4-fb03-4211-8d89-33fb794038da tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.464873 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eae0a2f4-fb03-4211-8d89-33fb794038da tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.465317 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eae0a2f4-fb03-4211-8d89-33fb794038da tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.470573 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eae0a2f4-fb03-4211-8d89-33fb794038da tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.471537 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eae0a2f4-fb03-4211-8d89-33fb794038da tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.472000 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eae0a2f4-fb03-4211-8d89-33fb794038da tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.531053 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.570163 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.575418 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.579292 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9d376f0e-c280-46c9-af7a-53c1385765af tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1743 microversion: 2.20 time: 0.426519 Aug 31 00:22:56.584013 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 123/242] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:56 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1743 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:56.630154 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-eae0a2f4-fb03-4211-8d89-33fb794038da tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.647593 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-eae0a2f4-fb03-4211-8d89-33fb794038da tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1271 microversion: 2.1 time: 0.208492 Aug 31 00:22:56.648878 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 120/243] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:56 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:57.209480 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1583356973", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5d24600-1d04-47b6-a84d-0a5669f6e4ab"}], "security_groups": [{"name": "tempest-securitygroup--1571403239"}], "key_name": "tempest-keypair-747050452", "user_data": "}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:57.467329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6e7ebded-53e0-4597-bcea-0975fac5dfd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:57.468506 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6e7ebded-53e0-4597-bcea-0975fac5dfd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:57.488188 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e7ebded-53e0-4597-bcea-0975fac5dfd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:57.490094 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e7ebded-53e0-4597-bcea-0975fac5dfd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:57.491709 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e7ebded-53e0-4597-bcea-0975fac5dfd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:57.495021 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e7ebded-53e0-4597-bcea-0975fac5dfd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:57.496222 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e7ebded-53e0-4597-bcea-0975fac5dfd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:57.497515 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6e7ebded-53e0-4597-bcea-0975fac5dfd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:57.931986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.network.neutron [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] validate_networks() for [('f5d24600-1d04-47b6-a84d-0a5669f6e4ab', None, None, None, None, None)] {{(pid=127118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:22:58.271746 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6e7ebded-53e0-4597-bcea-0975fac5dfd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:58.292877 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6e7ebded-53e0-4597-bcea-0975fac5dfd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1707 microversion: 2.1 time: 0.839835 Aug 31 00:22:58.296672 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 121/244] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:57 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1707 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:58.311950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:58.313587 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:58.332831 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:58.336513 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:58.337941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:58.340320 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:58.341465 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:58.342709 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.330606 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:59.355450 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:59.375564 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:59.378463 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d27c77dd-4a75-4f06-bd6a-ca4af428575b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1743 microversion: 2.20 time: 1.079006 Aug 31 00:22:59.380245 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 122/245] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:58 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1743 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:59.390979 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f6f10621-1874-4126-9a3d-178f13f4cd03 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:59.392629 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f6f10621-1874-4126-9a3d-178f13f4cd03 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:59.406673 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6f10621-1874-4126-9a3d-178f13f4cd03 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.419411 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6f10621-1874-4126-9a3d-178f13f4cd03 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.420702 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6f10621-1874-4126-9a3d-178f13f4cd03 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.422337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6f10621-1874-4126-9a3d-178f13f4cd03 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.426642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6f10621-1874-4126-9a3d-178f13f4cd03 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.427249 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6f10621-1874-4126-9a3d-178f13f4cd03 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.802582 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f6f10621-1874-4126-9a3d-178f13f4cd03 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:59.824673 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f6f10621-1874-4126-9a3d-178f13f4cd03 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1277 microversion: 2.1 time: 0.431397 Aug 31 00:22:59.825817 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 123/246] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:59 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1277 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:59.854300 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-bf311507-ba59-4255-bc7c-82834d3f21a5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:59.856350 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-bf311507-ba59-4255-bc7c-82834d3f21a5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:59.887118 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf311507-ba59-4255-bc7c-82834d3f21a5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.891843 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf311507-ba59-4255-bc7c-82834d3f21a5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.896275 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf311507-ba59-4255-bc7c-82834d3f21a5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.901636 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf311507-ba59-4255-bc7c-82834d3f21a5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.903644 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf311507-ba59-4255-bc7c-82834d3f21a5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.906597 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf311507-ba59-4255-bc7c-82834d3f21a5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.356997 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Flavor limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:23:00.358066 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Image limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:23:00.358725 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Flavor pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:23:00.359315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Image pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:23:00.359970 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:23:00.365166 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-bf311507-ba59-4255-bc7c-82834d3f21a5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:00.376028 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.376874 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.377618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.378621 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.379265 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.380068 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.386689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:00.426914 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Getting quotas for project af873e6a013c457aa2407fb24423ddc1. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:23:00.428980 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-bf311507-ba59-4255-bc7c-82834d3f21a5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1707 microversion: 2.1 time: 0.585975 Aug 31 00:23:00.430511 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 124/247] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:59 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1707 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:00.438362 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-498985df-2262-494a-8846-b1905e125e45 req-ab2ed530-50a1-4e54-a463-62f82e7b2896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a312d8-6cb2-4da8-a19b-215372294799", "name": "network-vif-plugged", "status": "completed", "tag": "0ff0dbfa-0c17-4d1f-bc12-fdd58530b639"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:00.447338 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Getting quotas for user f8ffd2d3c0c141118a7a9a5696c383e1 and project af873e6a013c457aa2407fb24423ddc1. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:23:00.463545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Going to run 1 instances... {{(pid=127118) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:23:00.466574 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:23:00.467570 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-498985df-2262-494a-8846-b1905e125e45 req-ab2ed530-50a1-4e54-a463-62f82e7b2896 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.468618 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-498985df-2262-494a-8846-b1905e125e45 req-ab2ed530-50a1-4e54-a463-62f82e7b2896 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.469755 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-498985df-2262-494a-8846-b1905e125e45 req-ab2ed530-50a1-4e54-a463-62f82e7b2896 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.507599 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-498985df-2262-494a-8846-b1905e125e45 req-ab2ed530-50a1-4e54-a463-62f82e7b2896 service nova] Creating event network-vif-plugged:0ff0dbfa-0c17-4d1f-bc12-fdd58530b639 for instance e3a312d8-6cb2-4da8-a19b-215372294799 on hv-cinder-85221 Aug 31 00:23:00.521314 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-498985df-2262-494a-8846-b1905e125e45 req-ab2ed530-50a1-4e54-a463-62f82e7b2896 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088193 Aug 31 00:23:00.522810 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 125/248] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:00.533394 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:00.535814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:00.552664 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3c2b22c7-52a4-47ec-8f2d-2a0269597bdd tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.353985 Aug 31 00:23:00.555208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.555208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.555969 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.556850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 124/249] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:22:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 3360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:23:00.557731 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.559682 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.560722 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.571719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c820e3ad-eb14-4706-aa21-dee386a88a79 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:00.572665 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c820e3ad-eb14-4706-aa21-dee386a88a79 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:00.720225 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c820e3ad-eb14-4706-aa21-dee386a88a79 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:00.746492 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c820e3ad-eb14-4706-aa21-dee386a88a79 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1245 microversion: 2.1 time: 0.174654 Aug 31 00:23:00.764645 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 125/250] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:00 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1245 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:00.871830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-fb45c2fa-01bc-4bd5-a377-aa0c1f8b6a39 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:00.874399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-fb45c2fa-01bc-4bd5-a377-aa0c1f8b6a39 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:00.894714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb45c2fa-01bc-4bd5-a377-aa0c1f8b6a39 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.896021 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb45c2fa-01bc-4bd5-a377-aa0c1f8b6a39 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.897024 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb45c2fa-01bc-4bd5-a377-aa0c1f8b6a39 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.898540 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb45c2fa-01bc-4bd5-a377-aa0c1f8b6a39 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.902043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb45c2fa-01bc-4bd5-a377-aa0c1f8b6a39 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.903320 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb45c2fa-01bc-4bd5-a377-aa0c1f8b6a39 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:01.170280 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:01.203197 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:01.208708 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:01.211821 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2266d9aa-16ae-44b8-931e-2f9e4180e53d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1738 microversion: 2.20 time: 0.686140 Aug 31 00:23:01.213047 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 126/251] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:00 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1738 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:01.225180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1640054141", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452"}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:01.689741 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-fb45c2fa-01bc-4bd5-a377-aa0c1f8b6a39 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:01.731582 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-fb45c2fa-01bc-4bd5-a377-aa0c1f8b6a39 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1319 microversion: 2.1 time: 0.870710 Aug 31 00:23:01.733423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 126/252] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:00 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1319 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:01.753594 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d242dcc3-ef1e-4b0c-a84a-f6fecd0edf7a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:01.761828 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d242dcc3-ef1e-4b0c-a84a-f6fecd0edf7a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:01.792419 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d242dcc3-ef1e-4b0c-a84a-f6fecd0edf7a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:01.793775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d242dcc3-ef1e-4b0c-a84a-f6fecd0edf7a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:01.794853 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d242dcc3-ef1e-4b0c-a84a-f6fecd0edf7a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:01.796757 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d242dcc3-ef1e-4b0c-a84a-f6fecd0edf7a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:01.797934 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d242dcc3-ef1e-4b0c-a84a-f6fecd0edf7a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:01.800740 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d242dcc3-ef1e-4b0c-a84a-f6fecd0edf7a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:02.372250 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d242dcc3-ef1e-4b0c-a84a-f6fecd0edf7a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:02.427828 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d242dcc3-ef1e-4b0c-a84a-f6fecd0edf7a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1711 microversion: 2.1 time: 0.691819 Aug 31 00:23:02.439444 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 127/253] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:01 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1711 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:02.501216 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-00d9f170-0a00-4289-a7d3-ccc20b63eeda tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:02.503493 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-00d9f170-0a00-4289-a7d3-ccc20b63eeda tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:02.534796 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00d9f170-0a00-4289-a7d3-ccc20b63eeda tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:02.538207 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00d9f170-0a00-4289-a7d3-ccc20b63eeda tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:02.539364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00d9f170-0a00-4289-a7d3-ccc20b63eeda tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:02.541648 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00d9f170-0a00-4289-a7d3-ccc20b63eeda tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:02.543674 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00d9f170-0a00-4289-a7d3-ccc20b63eeda tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:02.546452 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00d9f170-0a00-4289-a7d3-ccc20b63eeda tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:02.805153 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-00d9f170-0a00-4289-a7d3-ccc20b63eeda tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:02.820462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-00d9f170-0a00-4289-a7d3-ccc20b63eeda tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1297 microversion: 2.1 time: 0.374679 Aug 31 00:23:02.824788 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 128/254] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:02 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1297 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:02.831964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:02.832922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:02.842847 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:02.843676 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:02.844344 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:02.845504 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:02.847101 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:02.847911 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:03.226007 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:03.244867 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:03.247808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:03.250814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b1e3ab6b-519a-4c95-b4d4-dbb24cb97764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1738 microversion: 2.20 time: 0.423523 Aug 31 00:23:03.251969 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 129/255] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:02 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1738 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:03.263169 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-686dde5e-f63f-4044-a6dc-f9df14f7eb62 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:03.265279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-686dde5e-f63f-4044-a6dc-f9df14f7eb62 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:03.299585 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-686dde5e-f63f-4044-a6dc-f9df14f7eb62 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:03.310513 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-686dde5e-f63f-4044-a6dc-f9df14f7eb62 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:03.311583 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-686dde5e-f63f-4044-a6dc-f9df14f7eb62 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:03.312915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-686dde5e-f63f-4044-a6dc-f9df14f7eb62 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:03.313816 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-686dde5e-f63f-4044-a6dc-f9df14f7eb62 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:03.315009 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-686dde5e-f63f-4044-a6dc-f9df14f7eb62 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:03.862687 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:03.898439 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=6 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:04.120405 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-686dde5e-f63f-4044-a6dc-f9df14f7eb62 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:04.149671 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-686dde5e-f63f-4044-a6dc-f9df14f7eb62 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1319 microversion: 2.1 time: 0.893468 Aug 31 00:23:04.151356 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 130/256] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:03 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1319 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:04.163591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-66415a04-14e0-41be-b31b-cb93d87409e8 req-ddf8f03e-5fca-4ed8-83f8-fff23e5ac93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166c7ed8-54c6-4829-8e41-217e47eaecb7", "tag": "bf93a34c-ae93-4182-80ce-4c70d2e698de"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:04.205059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:04.213215 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-66415a04-14e0-41be-b31b-cb93d87409e8 req-ddf8f03e-5fca-4ed8-83f8-fff23e5ac93a service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:04.214446 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-66415a04-14e0-41be-b31b-cb93d87409e8 req-ddf8f03e-5fca-4ed8-83f8-fff23e5ac93a service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:04.215446 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-66415a04-14e0-41be-b31b-cb93d87409e8 req-ddf8f03e-5fca-4ed8-83f8-fff23e5ac93a service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:04.247561 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-66415a04-14e0-41be-b31b-cb93d87409e8 req-ddf8f03e-5fca-4ed8-83f8-fff23e5ac93a service nova] Creating event network-changed:bf93a34c-ae93-4182-80ce-4c70d2e698de for instance 166c7ed8-54c6-4829-8e41-217e47eaecb7 on hv-cinder-85221 Aug 31 00:23:04.263193 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-66415a04-14e0-41be-b31b-cb93d87409e8 req-ddf8f03e-5fca-4ed8-83f8-fff23e5ac93a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109398 Aug 31 00:23:04.264300 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 131/257] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:04.279863 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2a450d80-f3de-4efe-894e-4da28afa3d0a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: .version_select at 0x7f1a3aa16790>, body: {"keypair": {"name": "tempest-keypair-546715687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5dEsA5ACY95w/FLT7LULJkz1AGrdTBIIt2jBdeLHrRoc0kWIvy+zcAZ4v1Y4dd3hla+A429bkQxnZLnThOPWxuIM4AslyFBhYtwrWCslA1OB7PoOUK0u6BLQaVbu/nPw=="}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:04.323739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-2a450d80-f3de-4efe-894e-4da28afa3d0a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:23:04.333017 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-2a450d80-f3de-4efe-894e-4da28afa3d0a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for user b3da9d7af0fd4c1d99973e6b277b16d2 and project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:23:04.398052 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2a450d80-f3de-4efe-894e-4da28afa3d0a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126185 Aug 31 00:23:04.399510 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 132/258] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 31 00:23:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:04.419405 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c47900e2-b71d-49c2-bf44-3325ae56c531 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:04.422305 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c47900e2-b71d-49c2-bf44-3325ae56c531 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:04.435498 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c47900e2-b71d-49c2-bf44-3325ae56c531 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:04.436958 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c47900e2-b71d-49c2-bf44-3325ae56c531 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:04.438114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c47900e2-b71d-49c2-bf44-3325ae56c531 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:04.442573 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c47900e2-b71d-49c2-bf44-3325ae56c531 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:04.443912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c47900e2-b71d-49c2-bf44-3325ae56c531 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:04.445134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c47900e2-b71d-49c2-bf44-3325ae56c531 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:04.801057 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c47900e2-b71d-49c2-bf44-3325ae56c531 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:04.837126 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c47900e2-b71d-49c2-bf44-3325ae56c531 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1303 microversion: 2.1 time: 0.420854 Aug 31 00:23:04.839334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 133/259] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:04 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1303 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:04.859645 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:04.875858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:04.884922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:04.885760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:04.886411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:04.887752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:04.888670 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:04.889398 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:05.401381 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:05.458088 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:05.461870 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:05.465704 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-947aefa1-b54a-4342-85cb-a7f8adeb5a98 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1738 microversion: 2.20 time: 0.625736 Aug 31 00:23:05.468715 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 134/260] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:04 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1738 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:05.495467 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-02218660-c765-4040-ab18-b4b9d3ca0898 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:05.498345 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-02218660-c765-4040-ab18-b4b9d3ca0898 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:05.522470 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02218660-c765-4040-ab18-b4b9d3ca0898 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:05.525189 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02218660-c765-4040-ab18-b4b9d3ca0898 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:05.526340 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02218660-c765-4040-ab18-b4b9d3ca0898 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:05.528282 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02218660-c765-4040-ab18-b4b9d3ca0898 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:05.529971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02218660-c765-4040-ab18-b4b9d3ca0898 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:05.531174 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02218660-c765-4040-ab18-b4b9d3ca0898 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:05.967331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-02218660-c765-4040-ab18-b4b9d3ca0898 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:05.990345 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-02218660-c765-4040-ab18-b4b9d3ca0898 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1319 microversion: 2.1 time: 0.519298 Aug 31 00:23:06.003604 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 135/261] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:05 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:06.016841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7577090a-d827-456b-8976-d6089a2de3d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:06.017661 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7577090a-d827-456b-8976-d6089a2de3d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:06.034708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7577090a-d827-456b-8976-d6089a2de3d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.034708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7577090a-d827-456b-8976-d6089a2de3d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.034708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7577090a-d827-456b-8976-d6089a2de3d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:06.034708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7577090a-d827-456b-8976-d6089a2de3d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.035501 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7577090a-d827-456b-8976-d6089a2de3d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.035501 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7577090a-d827-456b-8976-d6089a2de3d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:06.290204 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7577090a-d827-456b-8976-d6089a2de3d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:06.316834 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7577090a-d827-456b-8976-d6089a2de3d8 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1303 microversion: 2.1 time: 0.310827 Aug 31 00:23:06.323027 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 136/262] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:06 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1303 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:06.515413 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:06.518763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:06.552551 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.554257 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.558845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:06.563826 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.569069 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.572118 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:07.411972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:07.455286 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:07.464460 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:07.467370 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2380a942-0dbc-47a8-8647-65cf928898ef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1738 microversion: 2.20 time: 0.962303 Aug 31 00:23:07.481331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 137/263] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:06 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1738 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:07.490624 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-04a04b77-f3ce-447f-b654-78054a986b53 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:07.495760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-04a04b77-f3ce-447f-b654-78054a986b53 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:07.522299 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04a04b77-f3ce-447f-b654-78054a986b53 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:07.525033 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04a04b77-f3ce-447f-b654-78054a986b53 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:07.526084 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04a04b77-f3ce-447f-b654-78054a986b53 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:07.528290 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04a04b77-f3ce-447f-b654-78054a986b53 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:07.531706 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04a04b77-f3ce-447f-b654-78054a986b53 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:07.536258 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04a04b77-f3ce-447f-b654-78054a986b53 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:08.680945 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-04a04b77-f3ce-447f-b654-78054a986b53 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:08.691262 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-04a04b77-f3ce-447f-b654-78054a986b53 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1319 microversion: 2.1 time: 1.208047 Aug 31 00:23:08.700463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 138/264] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:07 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1319 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:08.712889 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4a703efc-dd2a-4326-8ef9-6ab2f126cec0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:08.713812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4a703efc-dd2a-4326-8ef9-6ab2f126cec0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:08.720783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a703efc-dd2a-4326-8ef9-6ab2f126cec0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:08.722152 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a703efc-dd2a-4326-8ef9-6ab2f126cec0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:08.722887 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a703efc-dd2a-4326-8ef9-6ab2f126cec0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:08.723850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a703efc-dd2a-4326-8ef9-6ab2f126cec0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:08.724359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a703efc-dd2a-4326-8ef9-6ab2f126cec0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:08.724988 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a703efc-dd2a-4326-8ef9-6ab2f126cec0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:09.061576 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4a703efc-dd2a-4326-8ef9-6ab2f126cec0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:09.087826 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4a703efc-dd2a-4326-8ef9-6ab2f126cec0 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1371 microversion: 2.1 time: 0.385034 Aug 31 00:23:09.097408 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 139/265] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:08 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:09.120218 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:09.123009 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:09.145606 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:09.146444 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:09.147074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:09.148063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:09.149041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:09.149954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:09.539039 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:09.563381 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:09.567957 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:09.572215 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e85b92f5-43e6-4bc8-b217-c3aceb337923 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1738 microversion: 2.20 time: 0.472008 Aug 31 00:23:09.587823 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 140/266] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:09 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1738 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:09.603143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1770709231", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "923db031-4095-45ac-869f-da21aba3a797"}], "security_groups": [{"name": "tempest-securitygroup--2078829871"}], "key_name": "tempest-keypair-546715687", "user_data": "}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:10.394055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:11.004780 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] validate_networks() for None {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:23:11.185601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=89 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:11.248693 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:11.726903 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.network.neutron [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] validate_networks() for [('923db031-4095-45ac-869f-da21aba3a797', None, None, None, None, None)] {{(pid=127118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:23:12.106396 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:23:12.107123 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:23:12.108312 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:23:12.113659 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:23:12.114373 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:23:12.130757 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.131639 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.132465 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.133654 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.134436 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.135136 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.173556 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Getting quotas for project 9e164298f9d449498f1c7b4c06a839be. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:23:12.181251 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Getting quotas for user 46a26318c91b4976970c88d3c967ca10 and project 9e164298f9d449498f1c7b4c06a839be. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:23:12.214161 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:23:12.218234 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:23:12.338342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-55b249c0-2ab7-440d-b8b5-38c75d56c788 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.121934 Aug 31 00:23:12.345189 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 127/267] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:23:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 11126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:23:12.354692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f9ba25ca-c4ad-4db4-ac60-ab416d7af53e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:12.355848 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f9ba25ca-c4ad-4db4-ac60-ab416d7af53e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:12.367619 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9ba25ca-c4ad-4db4-ac60-ab416d7af53e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.370173 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9ba25ca-c4ad-4db4-ac60-ab416d7af53e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.370647 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9ba25ca-c4ad-4db4-ac60-ab416d7af53e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.371417 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9ba25ca-c4ad-4db4-ac60-ab416d7af53e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.373852 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9ba25ca-c4ad-4db4-ac60-ab416d7af53e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.374242 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f9ba25ca-c4ad-4db4-ac60-ab416d7af53e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.668431 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f9ba25ca-c4ad-4db4-ac60-ab416d7af53e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:12.697450 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f9ba25ca-c4ad-4db4-ac60-ab416d7af53e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1319 microversion: 2.1 time: 0.355797 Aug 31 00:23:12.702777 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 128/268] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:12 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:12.716969 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-07004ee9-7864-4520-8dd0-931c9a85fc7e req-867c0866-31ac-4ec1-9d1e-07130d866f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e8d6e3-f38c-4d75-8f36-60f17fec87a4", "tag": "bb85f003-67c3-4300-9f2a-5e9218c74a03"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:12.743937 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Flavor limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:23:12.746319 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-07004ee9-7864-4520-8dd0-931c9a85fc7e req-867c0866-31ac-4ec1-9d1e-07130d866f06 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.746491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Image limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:23:12.747228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Flavor pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:23:12.747374 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-07004ee9-7864-4520-8dd0-931c9a85fc7e req-867c0866-31ac-4ec1-9d1e-07130d866f06 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.748327 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-07004ee9-7864-4520-8dd0-931c9a85fc7e req-867c0866-31ac-4ec1-9d1e-07130d866f06 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.749571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Image pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:23:12.750223 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:23:12.767319 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.769491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.770563 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.771643 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.772334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.773196 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.776613 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-07004ee9-7864-4520-8dd0-931c9a85fc7e req-867c0866-31ac-4ec1-9d1e-07130d866f06 service nova] Creating event network-changed:bb85f003-67c3-4300-9f2a-5e9218c74a03 for instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 on hv-cinder-85221 Aug 31 00:23:12.789236 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-07004ee9-7864-4520-8dd0-931c9a85fc7e req-867c0866-31ac-4ec1-9d1e-07130d866f06 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083972 Aug 31 00:23:12.790931 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 129/269] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:12.802160 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c6d9ccf7-3455-4c00-bd37-a0d2dd6a0447 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:12.803463 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c6d9ccf7-3455-4c00-bd37-a0d2dd6a0447 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:12.812128 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:23:12.816727 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c6d9ccf7-3455-4c00-bd37-a0d2dd6a0447 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.817611 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c6d9ccf7-3455-4c00-bd37-a0d2dd6a0447 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.818415 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c6d9ccf7-3455-4c00-bd37-a0d2dd6a0447 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.819922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c6d9ccf7-3455-4c00-bd37-a0d2dd6a0447 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.820801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c6d9ccf7-3455-4c00-bd37-a0d2dd6a0447 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.821556 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c6d9ccf7-3455-4c00-bd37-a0d2dd6a0447 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.821796 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for user b3da9d7af0fd4c1d99973e6b277b16d2 and project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:23:12.850102 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Going to run 1 instances... {{(pid=127118) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:23:12.855153 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:23:12.991920 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-6fc36042-526c-4a68-bc1b-914532340077 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.401677 Aug 31 00:23:12.994114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 141/270] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:23:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 3405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:23:13.004782 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-cc7e6be3-e873-48eb-8bdd-b873a3da6d85 req-afd6bd34-dd9a-4ec0-98c7-09b869acdded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166c7ed8-54c6-4829-8e41-217e47eaecb7", "name": "network-vif-plugged", "status": "completed", "tag": "bf93a34c-ae93-4182-80ce-4c70d2e698de"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:13.028786 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-cc7e6be3-e873-48eb-8bdd-b873a3da6d85 req-afd6bd34-dd9a-4ec0-98c7-09b869acdded service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.029904 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-cc7e6be3-e873-48eb-8bdd-b873a3da6d85 req-afd6bd34-dd9a-4ec0-98c7-09b869acdded service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.030754 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-cc7e6be3-e873-48eb-8bdd-b873a3da6d85 req-afd6bd34-dd9a-4ec0-98c7-09b869acdded service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.060549 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-cc7e6be3-e873-48eb-8bdd-b873a3da6d85 req-afd6bd34-dd9a-4ec0-98c7-09b869acdded service nova] Creating event network-vif-plugged:bf93a34c-ae93-4182-80ce-4c70d2e698de for instance 166c7ed8-54c6-4829-8e41-217e47eaecb7 on hv-cinder-85221 Aug 31 00:23:13.070044 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-cc7e6be3-e873-48eb-8bdd-b873a3da6d85 req-afd6bd34-dd9a-4ec0-98c7-09b869acdded service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073650 Aug 31 00:23:13.076587 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 142/271] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:13.087673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:13.089362 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:13.102031 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.103280 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.104072 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.105369 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.106161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.108689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.701981 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c6d9ccf7-3455-4c00-bd37-a0d2dd6a0447 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:13.719646 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c6d9ccf7-3455-4c00-bd37-a0d2dd6a0447 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1371 microversion: 2.1 time: 0.925970 Aug 31 00:23:13.722641 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 130/272] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:12 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1371 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:13.731245 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8befc6be-b87e-4fc0-a49b-ab9ca1d9c489 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:13.731869 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8befc6be-b87e-4fc0-a49b-ab9ca1d9c489 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:13.751871 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8befc6be-b87e-4fc0-a49b-ab9ca1d9c489 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.757480 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8befc6be-b87e-4fc0-a49b-ab9ca1d9c489 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.758455 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8befc6be-b87e-4fc0-a49b-ab9ca1d9c489 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.762848 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8befc6be-b87e-4fc0-a49b-ab9ca1d9c489 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.763571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8befc6be-b87e-4fc0-a49b-ab9ca1d9c489 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.764030 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8befc6be-b87e-4fc0-a49b-ab9ca1d9c489 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.896276 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:13.918291 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:13.922507 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:13.927015 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5b0e744b-058e-4949-bbef-a4b13f2250bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1738 microversion: 2.20 time: 0.847876 Aug 31 00:23:13.928147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 143/273] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:13 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1738 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:13.948720 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8befc6be-b87e-4fc0-a49b-ab9ca1d9c489 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:13.958163 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-6b71c6ec-a28f-4bdf-a720-f6521f6125d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:13.959222 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-6b71c6ec-a28f-4bdf-a720-f6521f6125d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:13.964040 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8befc6be-b87e-4fc0-a49b-ab9ca1d9c489 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1211 microversion: 2.1 time: 0.240034 Aug 31 00:23:13.968976 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 131/274] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:13 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1211 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:13.979096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-20e0c654-7800-43bb-8a19-1c76cb56ded9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:13.981686 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-20e0c654-7800-43bb-8a19-1c76cb56ded9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:14.013295 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20e0c654-7800-43bb-8a19-1c76cb56ded9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.014009 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20e0c654-7800-43bb-8a19-1c76cb56ded9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.014470 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20e0c654-7800-43bb-8a19-1c76cb56ded9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:14.015238 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20e0c654-7800-43bb-8a19-1c76cb56ded9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.015731 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20e0c654-7800-43bb-8a19-1c76cb56ded9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.016179 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20e0c654-7800-43bb-8a19-1c76cb56ded9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:14.153150 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-6b71c6ec-a28f-4bdf-a720-f6521f6125d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:14.168036 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-6b71c6ec-a28f-4bdf-a720-f6521f6125d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1241 microversion: 2.1 time: 0.237956 Aug 31 00:23:14.169049 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 144/275] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:13 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1241 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:14.336197 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-20e0c654-7800-43bb-8a19-1c76cb56ded9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:14.349245 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-20e0c654-7800-43bb-8a19-1c76cb56ded9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1319 microversion: 2.1 time: 0.377798 Aug 31 00:23:14.358321 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 132/276] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:13 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:14.759924 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f92f8866-2631-4700-af9f-1c0b624ee0b3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:14.760582 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f92f8866-2631-4700-af9f-1c0b624ee0b3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:14.775176 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92f8866-2631-4700-af9f-1c0b624ee0b3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.776188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92f8866-2631-4700-af9f-1c0b624ee0b3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.777026 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92f8866-2631-4700-af9f-1c0b624ee0b3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:14.778295 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92f8866-2631-4700-af9f-1c0b624ee0b3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.779085 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92f8866-2631-4700-af9f-1c0b624ee0b3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.779594 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f92f8866-2631-4700-af9f-1c0b624ee0b3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.004028 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:15.006362 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f92f8866-2631-4700-af9f-1c0b624ee0b3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:15.013847 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:15.017169 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f92f8866-2631-4700-af9f-1c0b624ee0b3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1371 microversion: 2.1 time: 0.261205 Aug 31 00:23:15.032933 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 145/277] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:14 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:15.040007 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-95fa4cfc-0d81-4254-bb91-81c930acd50b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:15.041430 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-95fa4cfc-0d81-4254-bb91-81c930acd50b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:15.055085 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95fa4cfc-0d81-4254-bb91-81c930acd50b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.055598 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95fa4cfc-0d81-4254-bb91-81c930acd50b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.056045 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95fa4cfc-0d81-4254-bb91-81c930acd50b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.056974 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95fa4cfc-0d81-4254-bb91-81c930acd50b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.057699 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95fa4cfc-0d81-4254-bb91-81c930acd50b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.058135 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95fa4cfc-0d81-4254-bb91-81c930acd50b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.072697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.078151 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=100 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:15.079463 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.081939 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.089778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.093445 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.096236 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.318071 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-95fa4cfc-0d81-4254-bb91-81c930acd50b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:15.344279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-95fa4cfc-0d81-4254-bb91-81c930acd50b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1267 microversion: 2.1 time: 0.302042 Aug 31 00:23:15.360201 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 146/278] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:15 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1267 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:15.360201 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5a0c44e8-3012-4a76-97ce-df77fd80d68b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:15.360201 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5a0c44e8-3012-4a76-97ce-df77fd80d68b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:15.382354 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a0c44e8-3012-4a76-97ce-df77fd80d68b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.388007 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a0c44e8-3012-4a76-97ce-df77fd80d68b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.388850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a0c44e8-3012-4a76-97ce-df77fd80d68b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.389824 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a0c44e8-3012-4a76-97ce-df77fd80d68b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.390289 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a0c44e8-3012-4a76-97ce-df77fd80d68b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.390724 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a0c44e8-3012-4a76-97ce-df77fd80d68b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.682249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5a0c44e8-3012-4a76-97ce-df77fd80d68b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:15.692403 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5a0c44e8-3012-4a76-97ce-df77fd80d68b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1237 microversion: 2.1 time: 0.345015 Aug 31 00:23:15.693016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 147/279] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:15 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1237 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:15.698049 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8c4414f7-a986-4c01-820b-7efaa677b6f6 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:15.698935 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8c4414f7-a986-4c01-820b-7efaa677b6f6 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:15.709794 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c4414f7-a986-4c01-820b-7efaa677b6f6 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.710201 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c4414f7-a986-4c01-820b-7efaa677b6f6 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.710721 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c4414f7-a986-4c01-820b-7efaa677b6f6 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.711852 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c4414f7-a986-4c01-820b-7efaa677b6f6 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.712040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c4414f7-a986-4c01-820b-7efaa677b6f6 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.712592 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c4414f7-a986-4c01-820b-7efaa677b6f6 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.816524 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:15.830073 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:15.835793 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:15.838540 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-006e5b94-4bcb-4552-9109-20a1e5079fef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1738 microversion: 2.20 time: 0.854450 Aug 31 00:23:15.839892 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 133/280] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:14 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1738 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:15.957811 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8c4414f7-a986-4c01-820b-7efaa677b6f6 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:15.974881 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8c4414f7-a986-4c01-820b-7efaa677b6f6 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1319 microversion: 2.1 time: 0.280265 Aug 31 00:23:15.976453 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 148/281] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:15 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:16.039339 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5399e9dc-7f1b-421f-93f9-ef71cc57f2c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:16.040223 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5399e9dc-7f1b-421f-93f9-ef71cc57f2c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:16.047677 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5399e9dc-7f1b-421f-93f9-ef71cc57f2c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.048472 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5399e9dc-7f1b-421f-93f9-ef71cc57f2c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.049239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5399e9dc-7f1b-421f-93f9-ef71cc57f2c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:16.050877 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5399e9dc-7f1b-421f-93f9-ef71cc57f2c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.051980 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5399e9dc-7f1b-421f-93f9-ef71cc57f2c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.052773 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5399e9dc-7f1b-421f-93f9-ef71cc57f2c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:16.284501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5399e9dc-7f1b-421f-93f9-ef71cc57f2c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:16.301251 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5399e9dc-7f1b-421f-93f9-ef71cc57f2c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1371 microversion: 2.1 time: 0.263914 Aug 31 00:23:16.308861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 134/282] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:16 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:16.420669 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d02cc2c2-dc2f-4bc0-8868-2a6588715378 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:16.429374 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d02cc2c2-dc2f-4bc0-8868-2a6588715378 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:16.459322 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d02cc2c2-dc2f-4bc0-8868-2a6588715378 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.464787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d02cc2c2-dc2f-4bc0-8868-2a6588715378 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.465644 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d02cc2c2-dc2f-4bc0-8868-2a6588715378 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:16.466967 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d02cc2c2-dc2f-4bc0-8868-2a6588715378 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.467987 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d02cc2c2-dc2f-4bc0-8868-2a6588715378 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.470066 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d02cc2c2-dc2f-4bc0-8868-2a6588715378 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:16.732565 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d4f8a72b-9ff2-4954-9932-9416e948d2f8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:16.733595 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d4f8a72b-9ff2-4954-9932-9416e948d2f8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:16.747604 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4f8a72b-9ff2-4954-9932-9416e948d2f8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.748862 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4f8a72b-9ff2-4954-9932-9416e948d2f8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.750714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4f8a72b-9ff2-4954-9932-9416e948d2f8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:16.758572 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4f8a72b-9ff2-4954-9932-9416e948d2f8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.759444 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4f8a72b-9ff2-4954-9932-9416e948d2f8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.763659 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4f8a72b-9ff2-4954-9932-9416e948d2f8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.222100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d02cc2c2-dc2f-4bc0-8868-2a6588715378 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:17.258948 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d02cc2c2-dc2f-4bc0-8868-2a6588715378 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1267 microversion: 2.1 time: 0.868955 Aug 31 00:23:17.261264 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 149/283] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:16 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1267 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:17.273777 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:17.275947 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:17.277327 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d4f8a72b-9ff2-4954-9932-9416e948d2f8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:17.294136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:17.295181 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:17.296760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.298272 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:17.299391 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:17.300139 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.325285 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d4f8a72b-9ff2-4954-9932-9416e948d2f8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1293 microversion: 2.1 time: 0.602987 Aug 31 00:23:17.327811 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 135/284] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:16 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1293 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:17.336940 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-10ba284a-38b2-45d8-a0c1-f1a8f580b771 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:17.337562 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-10ba284a-38b2-45d8-a0c1-f1a8f580b771 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:17.350306 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10ba284a-38b2-45d8-a0c1-f1a8f580b771 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:17.350802 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10ba284a-38b2-45d8-a0c1-f1a8f580b771 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:17.351627 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10ba284a-38b2-45d8-a0c1-f1a8f580b771 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.352546 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10ba284a-38b2-45d8-a0c1-f1a8f580b771 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:17.353280 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10ba284a-38b2-45d8-a0c1-f1a8f580b771 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:17.368346 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10ba284a-38b2-45d8-a0c1-f1a8f580b771 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.950135 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:17.966082 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:17.968993 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:17.971651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-afdbc6df-e6b3-4996-b615-2db1f243a522 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1738 microversion: 2.20 time: 0.708109 Aug 31 00:23:17.984190 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 150/285] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:17 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1738 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:17.984190 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-502fa3d1-e12d-4151-aeb7-2e17d08be571 req-bb206fd2-5b13-41ac-8884-928c10de0662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e8d6e3-f38c-4d75-8f36-60f17fec87a4", "name": "network-vif-plugged", "status": "completed", "tag": "bb85f003-67c3-4300-9f2a-5e9218c74a03"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:17.997895 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-502fa3d1-e12d-4151-aeb7-2e17d08be571 req-bb206fd2-5b13-41ac-8884-928c10de0662 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:17.998785 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-502fa3d1-e12d-4151-aeb7-2e17d08be571 req-bb206fd2-5b13-41ac-8884-928c10de0662 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:17.999231 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-502fa3d1-e12d-4151-aeb7-2e17d08be571 req-bb206fd2-5b13-41ac-8884-928c10de0662 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.999596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-10ba284a-38b2-45d8-a0c1-f1a8f580b771 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:18.013824 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-10ba284a-38b2-45d8-a0c1-f1a8f580b771 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1507 microversion: 2.1 time: 0.684265 Aug 31 00:23:18.014467 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-502fa3d1-e12d-4151-aeb7-2e17d08be571 req-bb206fd2-5b13-41ac-8884-928c10de0662 service nova] Creating event network-vif-plugged:bb85f003-67c3-4300-9f2a-5e9218c74a03 for instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 on hv-cinder-85221 Aug 31 00:23:18.014877 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 136/286] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:17 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:18.019929 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-502fa3d1-e12d-4151-aeb7-2e17d08be571 req-bb206fd2-5b13-41ac-8884-928c10de0662 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045562 Aug 31 00:23:18.021051 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 151/287] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:18.025094 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9e10c66e-af2d-4411-8d59-96882183cfba tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:18.026100 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9e10c66e-af2d-4411-8d59-96882183cfba tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:18.038187 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e10c66e-af2d-4411-8d59-96882183cfba tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.039056 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e10c66e-af2d-4411-8d59-96882183cfba tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.039781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e10c66e-af2d-4411-8d59-96882183cfba tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.041381 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e10c66e-af2d-4411-8d59-96882183cfba tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.042255 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e10c66e-af2d-4411-8d59-96882183cfba tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.043007 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e10c66e-af2d-4411-8d59-96882183cfba tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.302621 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-616bc8bb-7f7f-4cfb-89fc-4b9176f2ba01 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:18.304040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-616bc8bb-7f7f-4cfb-89fc-4b9176f2ba01 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:18.315399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-616bc8bb-7f7f-4cfb-89fc-4b9176f2ba01 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.315889 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-616bc8bb-7f7f-4cfb-89fc-4b9176f2ba01 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.316792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-616bc8bb-7f7f-4cfb-89fc-4b9176f2ba01 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.318531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-616bc8bb-7f7f-4cfb-89fc-4b9176f2ba01 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.319209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-616bc8bb-7f7f-4cfb-89fc-4b9176f2ba01 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.319977 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-616bc8bb-7f7f-4cfb-89fc-4b9176f2ba01 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.459515 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-616bc8bb-7f7f-4cfb-89fc-4b9176f2ba01 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:18.464761 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9e10c66e-af2d-4411-8d59-96882183cfba tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:18.474315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-616bc8bb-7f7f-4cfb-89fc-4b9176f2ba01 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1273 microversion: 2.1 time: 0.179736 Aug 31 00:23:18.475255 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 152/288] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:18 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:18.480616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-368bb0e2-9772-4a41-a928-13722a268e40 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:18.481521 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-368bb0e2-9772-4a41-a928-13722a268e40 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:18.494468 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-368bb0e2-9772-4a41-a928-13722a268e40 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.495596 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-368bb0e2-9772-4a41-a928-13722a268e40 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.496434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-368bb0e2-9772-4a41-a928-13722a268e40 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.498193 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-368bb0e2-9772-4a41-a928-13722a268e40 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.499049 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-368bb0e2-9772-4a41-a928-13722a268e40 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.499695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-368bb0e2-9772-4a41-a928-13722a268e40 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.510148 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9e10c66e-af2d-4411-8d59-96882183cfba tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1371 microversion: 2.1 time: 0.493109 Aug 31 00:23:18.511224 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 137/289] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:18 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1371 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:18.881622 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-368bb0e2-9772-4a41-a928-13722a268e40 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:18.907862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-368bb0e2-9772-4a41-a928-13722a268e40 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1301 microversion: 2.1 time: 0.430902 Aug 31 00:23:18.917561 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 153/290] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:18 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1301 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:19.005061 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:19.006194 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:19.066769 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.068799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.069763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.071122 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.071980 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.072855 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.514004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0516c054-3dbe-4022-be3c-16755ccf154e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:19.514601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0516c054-3dbe-4022-be3c-16755ccf154e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:19.523000 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0516c054-3dbe-4022-be3c-16755ccf154e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.523599 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0516c054-3dbe-4022-be3c-16755ccf154e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.524502 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0516c054-3dbe-4022-be3c-16755ccf154e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.525347 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0516c054-3dbe-4022-be3c-16755ccf154e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.525805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0516c054-3dbe-4022-be3c-16755ccf154e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.526233 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0516c054-3dbe-4022-be3c-16755ccf154e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.689069 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0516c054-3dbe-4022-be3c-16755ccf154e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:19.701101 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0516c054-3dbe-4022-be3c-16755ccf154e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1273 microversion: 2.1 time: 0.191195 Aug 31 00:23:19.702131 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 154/291] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:19 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:19.723552 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2b794628-8f32-4f4e-b590-69c188fd1f97 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:19.725358 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2b794628-8f32-4f4e-b590-69c188fd1f97 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:19.739251 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b794628-8f32-4f4e-b590-69c188fd1f97 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.740093 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b794628-8f32-4f4e-b590-69c188fd1f97 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.741104 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b794628-8f32-4f4e-b590-69c188fd1f97 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.742673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b794628-8f32-4f4e-b590-69c188fd1f97 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.743455 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b794628-8f32-4f4e-b590-69c188fd1f97 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.744326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b794628-8f32-4f4e-b590-69c188fd1f97 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.760101 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:19.772365 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:19.774886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:19.777315 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a23dbec0-ef07-412c-865b-57165b0b3946 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1720 microversion: 2.20 time: 0.782810 Aug 31 00:23:19.778415 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 138/292] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:18 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1720 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:20.005068 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c2e06b90-c2e6-4e12-b51e-773de5e5b454 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:20.006718 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c2e06b90-c2e6-4e12-b51e-773de5e5b454 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:20.025798 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2e06b90-c2e6-4e12-b51e-773de5e5b454 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.026668 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2e06b90-c2e6-4e12-b51e-773de5e5b454 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.027732 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2e06b90-c2e6-4e12-b51e-773de5e5b454 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.029631 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2e06b90-c2e6-4e12-b51e-773de5e5b454 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.030710 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2e06b90-c2e6-4e12-b51e-773de5e5b454 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.036428 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2e06b90-c2e6-4e12-b51e-773de5e5b454 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.210715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c2e06b90-c2e6-4e12-b51e-773de5e5b454 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:20.223411 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c2e06b90-c2e6-4e12-b51e-773de5e5b454 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1299 microversion: 2.1 time: 0.232462 Aug 31 00:23:20.225439 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 139/293] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:19 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:20.273507 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2b794628-8f32-4f4e-b590-69c188fd1f97 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:20.298741 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2b794628-8f32-4f4e-b590-69c188fd1f97 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1371 microversion: 2.1 time: 0.585366 Aug 31 00:23:20.300676 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 155/294] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:19 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1371 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:20.711989 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-53c655de-1b55-4d7f-b6b0-ccd3bd18dfb9 req-7a3bc4ac-4ce2-41cb-864f-c44089433e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a312d8-6cb2-4da8-a19b-215372294799", "name": "network-vif-unplugged", "status": "completed", "tag": "0ff0dbfa-0c17-4d1f-bc12-fdd58530b639"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:20.730869 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8a3bac4a-7a2b-4469-b04d-65202821f1a7 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:20.732304 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8a3bac4a-7a2b-4469-b04d-65202821f1a7 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:20.742118 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-53c655de-1b55-4d7f-b6b0-ccd3bd18dfb9 req-7a3bc4ac-4ce2-41cb-864f-c44089433e99 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.746835 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-53c655de-1b55-4d7f-b6b0-ccd3bd18dfb9 req-7a3bc4ac-4ce2-41cb-864f-c44089433e99 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.748432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a3bac4a-7a2b-4469-b04d-65202821f1a7 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.749272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-53c655de-1b55-4d7f-b6b0-ccd3bd18dfb9 req-7a3bc4ac-4ce2-41cb-864f-c44089433e99 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.754324 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a3bac4a-7a2b-4469-b04d-65202821f1a7 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.755004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a3bac4a-7a2b-4469-b04d-65202821f1a7 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.756243 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a3bac4a-7a2b-4469-b04d-65202821f1a7 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.756984 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a3bac4a-7a2b-4469-b04d-65202821f1a7 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.757686 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a3bac4a-7a2b-4469-b04d-65202821f1a7 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.787395 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-53c655de-1b55-4d7f-b6b0-ccd3bd18dfb9 req-7a3bc4ac-4ce2-41cb-864f-c44089433e99 service nova] Creating event network-vif-unplugged:0ff0dbfa-0c17-4d1f-bc12-fdd58530b639 for instance e3a312d8-6cb2-4da8-a19b-215372294799 on hv-cinder-85221 Aug 31 00:23:20.802885 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-53c655de-1b55-4d7f-b6b0-ccd3bd18dfb9 req-7a3bc4ac-4ce2-41cb-864f-c44089433e99 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091467 Aug 31 00:23:20.808677 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 140/295] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:20.837198 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:20.838604 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:20.853299 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.854995 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.855809 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.857522 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.858909 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.859800 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:21.756632 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8a3bac4a-7a2b-4469-b04d-65202821f1a7 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:21.770576 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8a3bac4a-7a2b-4469-b04d-65202821f1a7 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1315 microversion: 2.1 time: 1.044347 Aug 31 00:23:21.771572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 156/296] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:20 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1315 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:21.782661 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2b233448-177b-4146-a17b-38d80ecf9c88 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:21.784893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2b233448-177b-4146-a17b-38d80ecf9c88 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:21.799828 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b233448-177b-4146-a17b-38d80ecf9c88 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:21.801500 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b233448-177b-4146-a17b-38d80ecf9c88 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:21.802807 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b233448-177b-4146-a17b-38d80ecf9c88 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:21.804029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b233448-177b-4146-a17b-38d80ecf9c88 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:21.804955 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b233448-177b-4146-a17b-38d80ecf9c88 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:21.805869 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b233448-177b-4146-a17b-38d80ecf9c88 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:21.809431 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:21.831788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:21.836277 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:21.839017 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-06b0bbcc-d43a-4c7b-ad89-9feb3726cf6d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1720 microversion: 2.20 time: 1.022776 Aug 31 00:23:21.841000 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 141/297] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:20 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1720 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:21.861077 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3d30ea1a-9a5c-4fbb-b616-d0c50dcb50e6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:21.862754 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3d30ea1a-9a5c-4fbb-b616-d0c50dcb50e6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:21.875593 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3d30ea1a-9a5c-4fbb-b616-d0c50dcb50e6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:21.876501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3d30ea1a-9a5c-4fbb-b616-d0c50dcb50e6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:21.878184 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3d30ea1a-9a5c-4fbb-b616-d0c50dcb50e6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:21.879555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3d30ea1a-9a5c-4fbb-b616-d0c50dcb50e6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:21.880561 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3d30ea1a-9a5c-4fbb-b616-d0c50dcb50e6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:21.881415 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3d30ea1a-9a5c-4fbb-b616-d0c50dcb50e6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:21.968230 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2b233448-177b-4146-a17b-38d80ecf9c88 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:21.997244 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2b233448-177b-4146-a17b-38d80ecf9c88 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1299 microversion: 2.1 time: 0.223542 Aug 31 00:23:21.998778 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 157/298] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:21 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1299 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:22.151676 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:22.204574 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=6 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:22.368335 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3d30ea1a-9a5c-4fbb-b616-d0c50dcb50e6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:22.394636 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3d30ea1a-9a5c-4fbb-b616-d0c50dcb50e6 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1565 microversion: 2.1 time: 0.551601 Aug 31 00:23:22.395370 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 142/299] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:21 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1565 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:22.431488 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4bbdca79-d787-4d91-a97d-9ebe1244eb17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:22.432742 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4bbdca79-d787-4d91-a97d-9ebe1244eb17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:22.444472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4bbdca79-d787-4d91-a97d-9ebe1244eb17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:22.444967 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4bbdca79-d787-4d91-a97d-9ebe1244eb17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:22.445696 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4bbdca79-d787-4d91-a97d-9ebe1244eb17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:22.446590 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4bbdca79-d787-4d91-a97d-9ebe1244eb17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:22.447048 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4bbdca79-d787-4d91-a97d-9ebe1244eb17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:22.447668 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4bbdca79-d787-4d91-a97d-9ebe1244eb17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:22.789774 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:22.817587 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-564b5d64-c2ca-43b6-864b-f5ed763c4a90 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:22.820656 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-564b5d64-c2ca-43b6-864b-f5ed763c4a90 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:22.836000 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-564b5d64-c2ca-43b6-864b-f5ed763c4a90 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:22.837184 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-564b5d64-c2ca-43b6-864b-f5ed763c4a90 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:22.838388 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-564b5d64-c2ca-43b6-864b-f5ed763c4a90 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:22.839682 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-564b5d64-c2ca-43b6-864b-f5ed763c4a90 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:22.840792 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-564b5d64-c2ca-43b6-864b-f5ed763c4a90 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:22.841429 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-564b5d64-c2ca-43b6-864b-f5ed763c4a90 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:22.858839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4bbdca79-d787-4d91-a97d-9ebe1244eb17 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.430517 Aug 31 00:23:22.860946 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 158/300] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 31 00:23:22 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-interface => generated 285 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:23:22.879414 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:22.880694 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:22.900669 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:22.901543 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:22.902531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:22.903870 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:22.904774 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:22.905552 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.479989 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-564b5d64-c2ca-43b6-864b-f5ed763c4a90 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:23.504562 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-564b5d64-c2ca-43b6-864b-f5ed763c4a90 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1315 microversion: 2.1 time: 0.694473 Aug 31 00:23:23.504737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:23.504940 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 143/301] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:22 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:23.517013 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4af10273-aab2-416b-b392-129ee17396a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:23.517783 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4af10273-aab2-416b-b392-129ee17396a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:23.535635 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4af10273-aab2-416b-b392-129ee17396a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:23.536920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4af10273-aab2-416b-b392-129ee17396a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:23.538046 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4af10273-aab2-416b-b392-129ee17396a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.539308 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4af10273-aab2-416b-b392-129ee17396a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:23.540291 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4af10273-aab2-416b-b392-129ee17396a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:23.541064 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4af10273-aab2-416b-b392-129ee17396a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.558137 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:23.562349 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:23.564294 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b85ce185-d36e-4fc7-bc2a-fdc9d4b30f84 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1720 microversion: 2.20 time: 0.692591 Aug 31 00:23:23.571582 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 159/302] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:22 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1720 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:23.771695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-88270a78-6920-471b-952b-a64aaf03931c req-7e57d2ac-77d6-4d8b-b3c1-b9cfb12c1e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d2b6c3-d9bd-46e8-a283-09a45974f0ab", "tag": "8f3f1405-2fc5-4b5e-aa6d-8b4237256828"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:23.790490 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-88270a78-6920-471b-952b-a64aaf03931c req-7e57d2ac-77d6-4d8b-b3c1-b9cfb12c1e97 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:23.791690 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-88270a78-6920-471b-952b-a64aaf03931c req-7e57d2ac-77d6-4d8b-b3c1-b9cfb12c1e97 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:23.792603 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-88270a78-6920-471b-952b-a64aaf03931c req-7e57d2ac-77d6-4d8b-b3c1-b9cfb12c1e97 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.805978 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-88270a78-6920-471b-952b-a64aaf03931c req-7e57d2ac-77d6-4d8b-b3c1-b9cfb12c1e97 service nova] Creating event network-changed:8f3f1405-2fc5-4b5e-aa6d-8b4237256828 for instance c7d2b6c3-d9bd-46e8-a283-09a45974f0ab on hv-cinder-85221 Aug 31 00:23:23.812748 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-88270a78-6920-471b-952b-a64aaf03931c req-7e57d2ac-77d6-4d8b-b3c1-b9cfb12c1e97 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046215 Aug 31 00:23:23.814232 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 160/303] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:23:23.860337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4af10273-aab2-416b-b392-129ee17396a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:23.872930 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4af10273-aab2-416b-b392-129ee17396a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 0.369008 Aug 31 00:23:23.873565 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 144/304] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:23 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:24.535263 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=26 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:24.542473 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-abe2edb2-10ea-4289-ac3c-e7ad8facc953 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:24.543599 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-abe2edb2-10ea-4289-ac3c-e7ad8facc953 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:24.556654 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abe2edb2-10ea-4289-ac3c-e7ad8facc953 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:24.558013 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abe2edb2-10ea-4289-ac3c-e7ad8facc953 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:24.558790 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abe2edb2-10ea-4289-ac3c-e7ad8facc953 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:24.560045 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abe2edb2-10ea-4289-ac3c-e7ad8facc953 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:24.561120 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abe2edb2-10ea-4289-ac3c-e7ad8facc953 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:24.562179 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abe2edb2-10ea-4289-ac3c-e7ad8facc953 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:24.598915 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:24.600080 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:24.610992 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:24.611867 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:24.619181 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:24.620988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:24.622099 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:24.623147 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:24.669465 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=100 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:25.037073 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:25.052974 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:25.060789 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:25.066152 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f1f23835-63ca-499f-81dc-9cf4acd3e96a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1720 microversion: 2.20 time: 0.470232 Aug 31 00:23:25.074425 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 145/305] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:24 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1720 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:23:25.084084 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-d20df9b7-7834-431a-a481-22f812a1e3d1 req-3c9cf708-bb18-4545-8f00-c3233ab5f5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e8d6e3-f38c-4d75-8f36-60f17fec87a4", "tag": "bb85f003-67c3-4300-9f2a-5e9218c74a03"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:25.129948 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-abe2edb2-10ea-4289-ac3c-e7ad8facc953 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:25.136522 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d20df9b7-7834-431a-a481-22f812a1e3d1 req-3c9cf708-bb18-4545-8f00-c3233ab5f5e0 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:25.139831 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d20df9b7-7834-431a-a481-22f812a1e3d1 req-3c9cf708-bb18-4545-8f00-c3233ab5f5e0 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:25.141272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d20df9b7-7834-431a-a481-22f812a1e3d1 req-3c9cf708-bb18-4545-8f00-c3233ab5f5e0 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:25.157083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-abe2edb2-10ea-4289-ac3c-e7ad8facc953 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1315 microversion: 2.1 time: 0.623772 Aug 31 00:23:25.162386 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 161/306] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:24 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:25.175941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4e1a9a10-4ae6-4d67-b259-fb1a9cf930be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:25.193863 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4e1a9a10-4ae6-4d67-b259-fb1a9cf930be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:25.212964 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-d20df9b7-7834-431a-a481-22f812a1e3d1 req-3c9cf708-bb18-4545-8f00-c3233ab5f5e0 service nova] Creating event network-changed:bb85f003-67c3-4300-9f2a-5e9218c74a03 for instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 on hv-cinder-85221 Aug 31 00:23:25.231592 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-d20df9b7-7834-431a-a481-22f812a1e3d1 req-3c9cf708-bb18-4545-8f00-c3233ab5f5e0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154334 Aug 31 00:23:25.249071 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 146/307] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:25.269017 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e1a9a10-4ae6-4d67-b259-fb1a9cf930be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:25.271429 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e1a9a10-4ae6-4d67-b259-fb1a9cf930be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:25.293821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e1a9a10-4ae6-4d67-b259-fb1a9cf930be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:25.295639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e1a9a10-4ae6-4d67-b259-fb1a9cf930be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:25.296633 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e1a9a10-4ae6-4d67-b259-fb1a9cf930be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:25.297539 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e1a9a10-4ae6-4d67-b259-fb1a9cf930be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:26.120442 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:26.123029 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:26.177757 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:26.182013 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:26.182760 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:26.183979 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:26.184784 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:26.185401 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:26.752134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4e1a9a10-4ae6-4d67-b259-fb1a9cf930be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:26.792863 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4e1a9a10-4ae6-4d67-b259-fb1a9cf930be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 1.618025 Aug 31 00:23:26.793972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 162/308] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:25 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:26.803277 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-df1b840f-042f-4323-8459-e6b59a4c7cd3 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:26.813415 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-df1b840f-042f-4323-8459-e6b59a4c7cd3 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:26.837760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df1b840f-042f-4323-8459-e6b59a4c7cd3 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:26.838968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df1b840f-042f-4323-8459-e6b59a4c7cd3 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:26.840297 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df1b840f-042f-4323-8459-e6b59a4c7cd3 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:26.842374 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df1b840f-042f-4323-8459-e6b59a4c7cd3 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:26.843508 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df1b840f-042f-4323-8459-e6b59a4c7cd3 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:26.845487 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df1b840f-042f-4323-8459-e6b59a4c7cd3 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:27.249583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:27.268138 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:27.270272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:27.272970 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9f399bac-487b-4014-bf47-f3b0ee5737ea tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1723 microversion: 2.20 time: 1.162658 Aug 31 00:23:27.274579 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 147/309] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:26 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1723 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:27.328381 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d45458b9-5f21-480a-8988-cc1b5c75f168 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cc7d608-159c-4843-8222-1e5d9eaaf833"}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:27.334845 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d45458b9-5f21-480a-8988-cc1b5c75f168 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:27.354907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d45458b9-5f21-480a-8988-cc1b5c75f168 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:27.358615 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d45458b9-5f21-480a-8988-cc1b5c75f168 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:27.360201 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d45458b9-5f21-480a-8988-cc1b5c75f168 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:27.363590 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d45458b9-5f21-480a-8988-cc1b5c75f168 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:27.364805 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d45458b9-5f21-480a-8988-cc1b5c75f168 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:27.365827 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d45458b9-5f21-480a-8988-cc1b5c75f168 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:27.602796 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-df1b840f-042f-4323-8459-e6b59a4c7cd3 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:27.612036 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-df1b840f-042f-4323-8459-e6b59a4c7cd3 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1315 microversion: 2.1 time: 0.815354 Aug 31 00:23:27.628523 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 163/310] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:26 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:27.831901 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a9d76ffe-7cb0-482f-9a88-0951232702f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:27.832943 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a9d76ffe-7cb0-482f-9a88-0951232702f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:27.850602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a9d76ffe-7cb0-482f-9a88-0951232702f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:27.851455 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a9d76ffe-7cb0-482f-9a88-0951232702f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:27.852098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a9d76ffe-7cb0-482f-9a88-0951232702f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:27.852926 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a9d76ffe-7cb0-482f-9a88-0951232702f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:27.853411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a9d76ffe-7cb0-482f-9a88-0951232702f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:27.853847 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a9d76ffe-7cb0-482f-9a88-0951232702f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:28.183768 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d45458b9-5f21-480a-8988-cc1b5c75f168 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "POST /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.864793 Aug 31 00:23:28.185744 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 148/311] 10.222.0.47 () {62 vars in 1364 bytes} [Wed Aug 31 00:23:27 2022] POST /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments => generated 188 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:23:28.340062 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a9d76ffe-7cb0-482f-9a88-0951232702f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:28.346297 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=100 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:28.396410 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a9d76ffe-7cb0-482f-9a88-0951232702f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 0.568812 Aug 31 00:23:28.397807 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 164/312] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:27 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:28.504330 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-e9c8a257-99c0-41fc-afd3-caf4ba1289e2 req-f7de8290-14cb-4011-ad55-fed7046a5a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fdf4278-aa30-4d1a-8c4d-94afd592aba5", "tag": "045ec9e3-1f50-4880-9a45-e10e1bd6b41b"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:28.520601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f729067e-6d8c-43dc-8a96-b229217fcaf1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:28.522260 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f729067e-6d8c-43dc-8a96-b229217fcaf1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:28.561377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e9c8a257-99c0-41fc-afd3-caf4ba1289e2 req-f7de8290-14cb-4011-ad55-fed7046a5a30 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:28.564040 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e9c8a257-99c0-41fc-afd3-caf4ba1289e2 req-f7de8290-14cb-4011-ad55-fed7046a5a30 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:28.565790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e9c8a257-99c0-41fc-afd3-caf4ba1289e2 req-f7de8290-14cb-4011-ad55-fed7046a5a30 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:28.567125 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f729067e-6d8c-43dc-8a96-b229217fcaf1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:28.571057 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f729067e-6d8c-43dc-8a96-b229217fcaf1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:28.571885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f729067e-6d8c-43dc-8a96-b229217fcaf1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:28.575804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f729067e-6d8c-43dc-8a96-b229217fcaf1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:28.586011 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f729067e-6d8c-43dc-8a96-b229217fcaf1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:28.587378 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f729067e-6d8c-43dc-8a96-b229217fcaf1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:28.614658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-e9c8a257-99c0-41fc-afd3-caf4ba1289e2 req-f7de8290-14cb-4011-ad55-fed7046a5a30 service nova] Creating event network-changed:045ec9e3-1f50-4880-9a45-e10e1bd6b41b for instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 on hv-cinder-85221 Aug 31 00:23:28.633731 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-e9c8a257-99c0-41fc-afd3-caf4ba1289e2 req-f7de8290-14cb-4011-ad55-fed7046a5a30 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135549 Aug 31 00:23:28.638750 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 149/313] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:28.664705 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-35470ee6-468f-4d27-b0eb-bbd309a480ad tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:28.666940 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-35470ee6-468f-4d27-b0eb-bbd309a480ad tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:28.680644 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35470ee6-468f-4d27-b0eb-bbd309a480ad tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:28.682256 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35470ee6-468f-4d27-b0eb-bbd309a480ad tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:28.683449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35470ee6-468f-4d27-b0eb-bbd309a480ad tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:28.686303 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35470ee6-468f-4d27-b0eb-bbd309a480ad tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:28.687611 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35470ee6-468f-4d27-b0eb-bbd309a480ad tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:28.688761 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35470ee6-468f-4d27-b0eb-bbd309a480ad tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:28.740055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f729067e-6d8c-43dc-8a96-b229217fcaf1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127118) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 00:23:28.790899 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:28.948284 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f729067e-6d8c-43dc-8a96-b229217fcaf1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "POST /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/action" status: 202 len: 0 microversion: 2.20 time: 0.435858 Aug 31 00:23:28.951515 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 165/314] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 31 00:23:28 2022] POST /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:23:28.964614 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:28.981227 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:29.012386 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:29.013230 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:29.015281 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:29.015432 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-35470ee6-468f-4d27-b0eb-bbd309a480ad tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:29.019128 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:29.019848 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:29.020920 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:29.044804 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-35470ee6-468f-4d27-b0eb-bbd309a480ad tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1315 microversion: 2.1 time: 0.388523 Aug 31 00:23:29.045903 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 150/315] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:28 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:29.315612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:29.346275 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:29.349765 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:29.362381 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-988e8ecc-b6aa-47d9-a3ad-7d638f6893e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1749 microversion: 2.20 time: 0.398468 Aug 31 00:23:29.363890 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 166/316] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:28 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1749 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:29.425837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cf900271-c73a-4ba1-a97c-474c4a40193f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:29.426472 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-cf900271-c73a-4ba1-a97c-474c4a40193f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:29.443289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf900271-c73a-4ba1-a97c-474c4a40193f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:29.444085 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf900271-c73a-4ba1-a97c-474c4a40193f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:29.444710 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf900271-c73a-4ba1-a97c-474c4a40193f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:29.454656 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf900271-c73a-4ba1-a97c-474c4a40193f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:29.455955 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf900271-c73a-4ba1-a97c-474c4a40193f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:29.456635 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf900271-c73a-4ba1-a97c-474c4a40193f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:29.785966 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cf900271-c73a-4ba1-a97c-474c4a40193f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:29.805142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cf900271-c73a-4ba1-a97c-474c4a40193f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 0.387146 Aug 31 00:23:29.806151 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 151/317] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:29 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:30.073049 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-56c7e892-7a3e-40d5-b079-40dcb05b006d tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:30.074321 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-56c7e892-7a3e-40d5-b079-40dcb05b006d tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:30.088097 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-56c7e892-7a3e-40d5-b079-40dcb05b006d tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:30.091398 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-56c7e892-7a3e-40d5-b079-40dcb05b006d tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:30.092182 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-56c7e892-7a3e-40d5-b079-40dcb05b006d tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:30.102034 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-56c7e892-7a3e-40d5-b079-40dcb05b006d tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:30.102517 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-56c7e892-7a3e-40d5-b079-40dcb05b006d tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:30.103184 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-56c7e892-7a3e-40d5-b079-40dcb05b006d tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:30.408999 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:30.411467 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:30.426026 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:30.427186 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:30.428643 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:30.432806 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:30.434082 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:30.435587 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:30.682201 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-56c7e892-7a3e-40d5-b079-40dcb05b006d tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:30.699444 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-56c7e892-7a3e-40d5-b079-40dcb05b006d tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1315 microversion: 2.1 time: 0.630320 Aug 31 00:23:30.711301 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 167/318] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:30 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:30.831026 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:30.837201 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7930a322-0ab9-48b7-8ff6-5815cad7ad8e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:30.841103 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:30.842345 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7930a322-0ab9-48b7-8ff6-5815cad7ad8e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:30.842617 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:30.843915 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d55b6d8e-87aa-4499-8168-2a3fece86846 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1749 microversion: 2.20 time: 0.445895 Aug 31 00:23:30.856186 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 152/319] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:30 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1749 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:30.864492 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7930a322-0ab9-48b7-8ff6-5815cad7ad8e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:30.865535 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7930a322-0ab9-48b7-8ff6-5815cad7ad8e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:30.866423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7930a322-0ab9-48b7-8ff6-5815cad7ad8e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:30.868078 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7930a322-0ab9-48b7-8ff6-5815cad7ad8e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:30.869109 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7930a322-0ab9-48b7-8ff6-5815cad7ad8e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:30.870015 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7930a322-0ab9-48b7-8ff6-5815cad7ad8e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:31.130852 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7930a322-0ab9-48b7-8ff6-5815cad7ad8e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:31.142503 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7930a322-0ab9-48b7-8ff6-5815cad7ad8e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 0.316001 Aug 31 00:23:31.144639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 168/320] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:30 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:31.725193 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2413e8e3-7f9b-457d-9f9d-66440d59547e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:31.725821 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2413e8e3-7f9b-457d-9f9d-66440d59547e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:31.743681 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2413e8e3-7f9b-457d-9f9d-66440d59547e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:31.745629 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2413e8e3-7f9b-457d-9f9d-66440d59547e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:31.746743 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2413e8e3-7f9b-457d-9f9d-66440d59547e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:31.748448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2413e8e3-7f9b-457d-9f9d-66440d59547e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:31.749597 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2413e8e3-7f9b-457d-9f9d-66440d59547e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:31.750721 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2413e8e3-7f9b-457d-9f9d-66440d59547e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:31.875688 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:31.878403 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:31.903483 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:31.904609 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:31.905763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:31.907482 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:31.909084 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:31.910133 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.179162 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2413e8e3-7f9b-457d-9f9d-66440d59547e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:32.206450 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2413e8e3-7f9b-457d-9f9d-66440d59547e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1315 microversion: 2.1 time: 0.486671 Aug 31 00:23:32.220906 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 153/321] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:31 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:32.244899 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c2433a4e-cef0-45b4-9ec1-8d0b209766f3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:32.246558 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c2433a4e-cef0-45b4-9ec1-8d0b209766f3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:32.262248 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:32.278336 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2433a4e-cef0-45b4-9ec1-8d0b209766f3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.287324 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2433a4e-cef0-45b4-9ec1-8d0b209766f3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.291012 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2433a4e-cef0-45b4-9ec1-8d0b209766f3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.292917 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2433a4e-cef0-45b4-9ec1-8d0b209766f3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.294181 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2433a4e-cef0-45b4-9ec1-8d0b209766f3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.299189 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:32.300816 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2433a4e-cef0-45b4-9ec1-8d0b209766f3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.312452 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:32.315924 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-84b49e6a-ed90-46f4-9488-fe4b693f1aef tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1749 microversion: 2.20 time: 0.447233 Aug 31 00:23:32.321476 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 169/322] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:31 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1749 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:23:33.261987 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2d97b2e7-64ce-46f4-896e-3755ebe8c803 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:33.265533 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c2433a4e-cef0-45b4-9ec1-8d0b209766f3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:33.266974 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2d97b2e7-64ce-46f4-896e-3755ebe8c803 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:33.285002 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2d97b2e7-64ce-46f4-896e-3755ebe8c803 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:33.285334 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c2433a4e-cef0-45b4-9ec1-8d0b209766f3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 1.061251 Aug 31 00:23:33.286769 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2d97b2e7-64ce-46f4-896e-3755ebe8c803 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:33.288006 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2d97b2e7-64ce-46f4-896e-3755ebe8c803 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:33.289975 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2d97b2e7-64ce-46f4-896e-3755ebe8c803 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:33.291273 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2d97b2e7-64ce-46f4-896e-3755ebe8c803 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:33.292490 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2d97b2e7-64ce-46f4-896e-3755ebe8c803 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:33.299506 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 154/323] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:32 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:33.350517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:33.351324 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:33.367499 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:33.368009 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:33.368791 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:33.370056 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:33.370922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:33.371728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:33.900057 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2d97b2e7-64ce-46f4-896e-3755ebe8c803 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:33.918392 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2d97b2e7-64ce-46f4-896e-3755ebe8c803 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1315 microversion: 2.1 time: 0.667661 Aug 31 00:23:33.919926 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 170/324] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:33 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:34.051659 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:34.093613 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:34.102640 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:34.107267 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f86e7be3-2fb1-40ca-8e97-b3903c487355 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1751 microversion: 2.20 time: 0.760469 Aug 31 00:23:34.126293 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 155/325] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:33 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1751 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:34.328610 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8be81265-b2a6-4c84-84a4-f3c739f03938 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:34.329721 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8be81265-b2a6-4c84-84a4-f3c739f03938 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:34.342821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8be81265-b2a6-4c84-84a4-f3c739f03938 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:34.343689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8be81265-b2a6-4c84-84a4-f3c739f03938 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:34.344478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8be81265-b2a6-4c84-84a4-f3c739f03938 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:34.346875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8be81265-b2a6-4c84-84a4-f3c739f03938 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:34.348349 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8be81265-b2a6-4c84-84a4-f3c739f03938 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:34.349452 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8be81265-b2a6-4c84-84a4-f3c739f03938 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:34.683738 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8be81265-b2a6-4c84-84a4-f3c739f03938 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:34.713836 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8be81265-b2a6-4c84-84a4-f3c739f03938 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 0.392071 Aug 31 00:23:34.726335 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 171/326] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:34 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:34.968781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cbd9843b-7971-412c-a310-68bbf15fab8a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:34.970274 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-cbd9843b-7971-412c-a310-68bbf15fab8a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:34.996570 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cbd9843b-7971-412c-a310-68bbf15fab8a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:34.997104 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cbd9843b-7971-412c-a310-68bbf15fab8a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:34.997871 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cbd9843b-7971-412c-a310-68bbf15fab8a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:34.999051 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cbd9843b-7971-412c-a310-68bbf15fab8a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:34.999957 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cbd9843b-7971-412c-a310-68bbf15fab8a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:35.000561 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cbd9843b-7971-412c-a310-68bbf15fab8a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:35.163838 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:35.168655 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:35.183787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:35.184810 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:35.185652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:35.186987 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:35.188070 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:35.189112 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:35.215089 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cbd9843b-7971-412c-a310-68bbf15fab8a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:35.226088 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cbd9843b-7971-412c-a310-68bbf15fab8a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1315 microversion: 2.1 time: 0.263492 Aug 31 00:23:35.227321 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 156/327] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:34 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:35.310220 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-0b6033af-804e-4dd0-bf43-f04624c11302 req-62d90106-e855-41ef-b959-23ee06bc8fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d2b6c3-d9bd-46e8-a283-09a45974f0ab", "name": "network-vif-plugged", "status": "completed", "tag": "8f3f1405-2fc5-4b5e-aa6d-8b4237256828"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:35.329577 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-0b6033af-804e-4dd0-bf43-f04624c11302 req-62d90106-e855-41ef-b959-23ee06bc8fbe service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:35.332227 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-0b6033af-804e-4dd0-bf43-f04624c11302 req-62d90106-e855-41ef-b959-23ee06bc8fbe service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:35.335975 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-0b6033af-804e-4dd0-bf43-f04624c11302 req-62d90106-e855-41ef-b959-23ee06bc8fbe service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:35.363878 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-0b6033af-804e-4dd0-bf43-f04624c11302 req-62d90106-e855-41ef-b959-23ee06bc8fbe service nova] Creating event network-vif-plugged:8f3f1405-2fc5-4b5e-aa6d-8b4237256828 for instance c7d2b6c3-d9bd-46e8-a283-09a45974f0ab on hv-cinder-85221 Aug 31 00:23:35.379579 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-0b6033af-804e-4dd0-bf43-f04624c11302 req-62d90106-e855-41ef-b959-23ee06bc8fbe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072070 Aug 31 00:23:35.381842 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 157/328] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:23:35.444682 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:35.458936 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:35.463417 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:35.466121 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-95c2f53c-b1eb-410d-aba7-55c008e53d8b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.317631 Aug 31 00:23:35.491605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 172/329] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:35 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:23:35.758207 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-520492b9-bd50-46a7-be6d-fca2dd746fd8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:35.762670 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-520492b9-bd50-46a7-be6d-fca2dd746fd8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:35.832819 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-520492b9-bd50-46a7-be6d-fca2dd746fd8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:35.834120 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-520492b9-bd50-46a7-be6d-fca2dd746fd8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:35.836382 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-520492b9-bd50-46a7-be6d-fca2dd746fd8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:35.840420 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-520492b9-bd50-46a7-be6d-fca2dd746fd8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:35.841337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-520492b9-bd50-46a7-be6d-fca2dd746fd8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:35.843399 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-520492b9-bd50-46a7-be6d-fca2dd746fd8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.123069 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-520492b9-bd50-46a7-be6d-fca2dd746fd8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:36.147594 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-520492b9-bd50-46a7-be6d-fca2dd746fd8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 0.400166 Aug 31 00:23:36.148239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 158/330] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:35 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:36.247144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5f7baca6-b65f-476d-958b-546085324111 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:36.247761 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5f7baca6-b65f-476d-958b-546085324111 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:36.261281 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5f7baca6-b65f-476d-958b-546085324111 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.262527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5f7baca6-b65f-476d-958b-546085324111 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.266317 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5f7baca6-b65f-476d-958b-546085324111 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.267669 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5f7baca6-b65f-476d-958b-546085324111 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.268553 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5f7baca6-b65f-476d-958b-546085324111 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.269360 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5f7baca6-b65f-476d-958b-546085324111 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.506691 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:36.508271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:36.519666 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.520943 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.522001 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.523471 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.524736 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.525805 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.632271 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5f7baca6-b65f-476d-958b-546085324111 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:36.670588 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5f7baca6-b65f-476d-958b-546085324111 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1315 microversion: 2.1 time: 0.426641 Aug 31 00:23:36.673194 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 173/331] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:36 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:36.820746 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:36.861777 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:36.878322 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:36.885506 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9317a3f5-88ad-42c5-b7b0-2798694222a2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.382561 Aug 31 00:23:36.887810 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 159/332] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:36 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:23:37.021575 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-40984383-9d5b-4c12-b95c-e350eb3b0b7b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "665b75af-e90f-4415-ae02-5593d166edde", "device": "/dev/sdb"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:37.027576 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-40984383-9d5b-4c12-b95c-e350eb3b0b7b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:37.058354 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-40984383-9d5b-4c12-b95c-e350eb3b0b7b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.063891 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-40984383-9d5b-4c12-b95c-e350eb3b0b7b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.065789 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-40984383-9d5b-4c12-b95c-e350eb3b0b7b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.073150 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-40984383-9d5b-4c12-b95c-e350eb3b0b7b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.078285 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-40984383-9d5b-4c12-b95c-e350eb3b0b7b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.079414 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-40984383-9d5b-4c12-b95c-e350eb3b0b7b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.177651 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d4078282-66ba-48bc-bf56-deab0e6696fc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:37.191171 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d4078282-66ba-48bc-bf56-deab0e6696fc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:37.215444 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4078282-66ba-48bc-bf56-deab0e6696fc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.221581 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4078282-66ba-48bc-bf56-deab0e6696fc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.228336 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4078282-66ba-48bc-bf56-deab0e6696fc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.230501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4078282-66ba-48bc-bf56-deab0e6696fc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.230767 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4078282-66ba-48bc-bf56-deab0e6696fc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.231765 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4078282-66ba-48bc-bf56-deab0e6696fc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.575882 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d4078282-66ba-48bc-bf56-deab0e6696fc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:37.598891 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d4078282-66ba-48bc-bf56-deab0e6696fc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 0.426229 Aug 31 00:23:37.602696 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 160/333] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:37 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:37.713161 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5705f536-86d6-4638-90c4-948ae017339b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:37.714326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5705f536-86d6-4638-90c4-948ae017339b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:37.732685 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5705f536-86d6-4638-90c4-948ae017339b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.733516 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5705f536-86d6-4638-90c4-948ae017339b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.734298 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5705f536-86d6-4638-90c4-948ae017339b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.740509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5705f536-86d6-4638-90c4-948ae017339b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.741420 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5705f536-86d6-4638-90c4-948ae017339b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.742264 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5705f536-86d6-4638-90c4-948ae017339b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.776769 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:38.038784 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5705f536-86d6-4638-90c4-948ae017339b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:38.047341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5705f536-86d6-4638-90c4-948ae017339b tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1465 microversion: 2.1 time: 0.351558 Aug 31 00:23:38.053434 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 161/334] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:37 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1465 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:38.061250 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-a1aec00d-9a01-4ede-bded-281c9aa59121 req-e3dc0c4f-af94-49dc-b3f9-b835db6f8991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdf4278-aa30-4d1a-8c4d-94afd592aba5", "name": "network-vif-plugged", "status": "completed", "tag": "045ec9e3-1f50-4880-9a45-e10e1bd6b41b"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:38.073561 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a1aec00d-9a01-4ede-bded-281c9aa59121 req-e3dc0c4f-af94-49dc-b3f9-b835db6f8991 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.074459 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a1aec00d-9a01-4ede-bded-281c9aa59121 req-e3dc0c4f-af94-49dc-b3f9-b835db6f8991 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.075115 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a1aec00d-9a01-4ede-bded-281c9aa59121 req-e3dc0c4f-af94-49dc-b3f9-b835db6f8991 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.090610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-a1aec00d-9a01-4ede-bded-281c9aa59121 req-e3dc0c4f-af94-49dc-b3f9-b835db6f8991 service nova] Creating event network-vif-plugged:045ec9e3-1f50-4880-9a45-e10e1bd6b41b for instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 on hv-cinder-85221 Aug 31 00:23:38.097776 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-a1aec00d-9a01-4ede-bded-281c9aa59121 req-e3dc0c4f-af94-49dc-b3f9-b835db6f8991 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042549 Aug 31 00:23:38.099341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 162/335] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:38.106425 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:38.107569 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:38.117928 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.118917 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.119644 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.120648 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.121507 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.122370 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.432180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:38.465706 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:38.467682 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:38.472005 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7f64cc74-f448-447a-adcd-9895afaf5169 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.370730 Aug 31 00:23:38.476394 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 163/336] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:38 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:38.497651 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-275d1288-a2bc-41c2-86fd-cf23c24282aa tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:38.500241 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-275d1288-a2bc-41c2-86fd-cf23c24282aa tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:38.525786 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-275d1288-a2bc-41c2-86fd-cf23c24282aa tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.530934 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-275d1288-a2bc-41c2-86fd-cf23c24282aa tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.531585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-275d1288-a2bc-41c2-86fd-cf23c24282aa tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.532432 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-275d1288-a2bc-41c2-86fd-cf23c24282aa tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.533456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-275d1288-a2bc-41c2-86fd-cf23c24282aa tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.533903 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-275d1288-a2bc-41c2-86fd-cf23c24282aa tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.564454 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-275d1288-a2bc-41c2-86fd-cf23c24282aa tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:23:38.647690 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-40984383-9d5b-4c12-b95c-e350eb3b0b7b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "POST /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.632258 Aug 31 00:23:38.654703 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 174/337] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:23:37 2022] POST /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7/os-volume_attachments => generated 194 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:38.678771 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-292674d0-ceae-4f77-ba0a-921a0ccc1398 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:38.683993 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-292674d0-ceae-4f77-ba0a-921a0ccc1398 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:38.726108 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-292674d0-ceae-4f77-ba0a-921a0ccc1398 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.730780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-292674d0-ceae-4f77-ba0a-921a0ccc1398 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.736441 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-292674d0-ceae-4f77-ba0a-921a0ccc1398 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.740801 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-292674d0-ceae-4f77-ba0a-921a0ccc1398 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.744020 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-292674d0-ceae-4f77-ba0a-921a0ccc1398 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.747258 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-292674d0-ceae-4f77-ba0a-921a0ccc1398 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.749900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-275d1288-a2bc-41c2-86fd-cf23c24282aa tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 204 len: 0 microversion: 2.1 time: 0.267176 Aug 31 00:23:38.751077 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 164/338] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:23:38 2022] DELETE /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:23:38.762592 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ff28aee0-eef8-419b-a1c2-a08d2bab9524 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:38.772562 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ff28aee0-eef8-419b-a1c2-a08d2bab9524 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:38.789951 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff28aee0-eef8-419b-a1c2-a08d2bab9524 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.790983 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff28aee0-eef8-419b-a1c2-a08d2bab9524 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.791681 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff28aee0-eef8-419b-a1c2-a08d2bab9524 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.792695 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff28aee0-eef8-419b-a1c2-a08d2bab9524 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.793373 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff28aee0-eef8-419b-a1c2-a08d2bab9524 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.794014 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff28aee0-eef8-419b-a1c2-a08d2bab9524 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:39.118868 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-292674d0-ceae-4f77-ba0a-921a0ccc1398 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:39.134642 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-292674d0-ceae-4f77-ba0a-921a0ccc1398 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 0.477366 Aug 31 00:23:39.140186 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ff28aee0-eef8-419b-a1c2-a08d2bab9524 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:39.164283 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 175/339] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:38 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:39.184571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ff28aee0-eef8-419b-a1c2-a08d2bab9524 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1471 microversion: 2.1 time: 0.427279 Aug 31 00:23:39.190811 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 165/340] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:38 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1471 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:39.519727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:39.520637 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:39.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:39.542850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:39.543520 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:39.544846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:39.545602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:39.546264 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:39.792804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:39.813147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:39.821701 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:39.824094 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4833b731-4655-4718-b46e-f77520f0036b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.308562 Aug 31 00:23:39.826845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 176/341] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:39 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:40.176067 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b625c7a0-7b9d-4bda-b26c-d7c14c6dc826 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:40.177216 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b625c7a0-7b9d-4bda-b26c-d7c14c6dc826 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:40.199827 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b625c7a0-7b9d-4bda-b26c-d7c14c6dc826 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:40.205801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b625c7a0-7b9d-4bda-b26c-d7c14c6dc826 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:40.206829 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b625c7a0-7b9d-4bda-b26c-d7c14c6dc826 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:40.208881 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b625c7a0-7b9d-4bda-b26c-d7c14c6dc826 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:40.211628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b625c7a0-7b9d-4bda-b26c-d7c14c6dc826 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:40.211996 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b625c7a0-7b9d-4bda-b26c-d7c14c6dc826 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:40.218312 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f929fd49-e4d6-4ef7-9ada-0eefb771e5b4 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:40.219478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f929fd49-e4d6-4ef7-9ada-0eefb771e5b4 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:40.249687 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f929fd49-e4d6-4ef7-9ada-0eefb771e5b4 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:40.250698 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f929fd49-e4d6-4ef7-9ada-0eefb771e5b4 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:40.251735 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f929fd49-e4d6-4ef7-9ada-0eefb771e5b4 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:40.253425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f929fd49-e4d6-4ef7-9ada-0eefb771e5b4 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:40.254294 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f929fd49-e4d6-4ef7-9ada-0eefb771e5b4 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:40.255055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f929fd49-e4d6-4ef7-9ada-0eefb771e5b4 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:40.658836 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b625c7a0-7b9d-4bda-b26c-d7c14c6dc826 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:40.674521 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b625c7a0-7b9d-4bda-b26c-d7c14c6dc826 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 0.506580 Aug 31 00:23:40.679137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 166/342] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:40 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:40.727222 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f929fd49-e4d6-4ef7-9ada-0eefb771e5b4 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:40.771482 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f929fd49-e4d6-4ef7-9ada-0eefb771e5b4 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1471 microversion: 2.1 time: 0.561630 Aug 31 00:23:40.778171 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 177/343] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:40 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1471 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:40.870414 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:40.871327 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:40.881014 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:40.901961 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:40.909331 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:40.913661 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:40.916050 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:40.916679 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:40.919523 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:41.263104 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:41.293393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:41.297281 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:41.302276 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5298e0ad-5abb-486f-8b1d-b112da950898 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.438289 Aug 31 00:23:41.304226 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 167/344] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:40 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:41.718272 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-22aafa2a-b4a6-470d-9dd4-668ab00f0cb8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:41.723561 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-22aafa2a-b4a6-470d-9dd4-668ab00f0cb8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:41.747485 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-22aafa2a-b4a6-470d-9dd4-668ab00f0cb8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:41.748785 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-22aafa2a-b4a6-470d-9dd4-668ab00f0cb8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:41.750273 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-22aafa2a-b4a6-470d-9dd4-668ab00f0cb8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:41.752831 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-22aafa2a-b4a6-470d-9dd4-668ab00f0cb8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:41.754295 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-22aafa2a-b4a6-470d-9dd4-668ab00f0cb8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:41.755458 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-22aafa2a-b4a6-470d-9dd4-668ab00f0cb8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:41.800758 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c2b930bf-26a8-4e3a-bfb2-1431720a7868 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:41.802343 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c2b930bf-26a8-4e3a-bfb2-1431720a7868 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:41.818142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2b930bf-26a8-4e3a-bfb2-1431720a7868 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:41.818949 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2b930bf-26a8-4e3a-bfb2-1431720a7868 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:41.819558 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2b930bf-26a8-4e3a-bfb2-1431720a7868 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:41.820509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2b930bf-26a8-4e3a-bfb2-1431720a7868 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:41.821147 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2b930bf-26a8-4e3a-bfb2-1431720a7868 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:41.821911 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c2b930bf-26a8-4e3a-bfb2-1431720a7868 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:41.945855 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:23:41.946606 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Wed Aug 31 00:23:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab (ip 10.222.0.47) !!! Aug 31 00:23:42.808718 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c2b930bf-26a8-4e3a-bfb2-1431720a7868 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:42.831071 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c2b930bf-26a8-4e3a-bfb2-1431720a7868 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1471 microversion: 2.1 time: 1.035051 Aug 31 00:23:42.832961 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 168/345] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:41 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1471 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:42.844997 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:42.847104 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:42.860301 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:42.862622 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:42.863648 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:42.869902 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:42.872092 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:42.873699 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:43.552634 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-22aafa2a-b4a6-470d-9dd4-668ab00f0cb8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:43.567807 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-22aafa2a-b4a6-470d-9dd4-668ab00f0cb8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1367 microversion: 2.1 time: 1.869484 Aug 31 00:23:43.571141 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 178/346] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:41 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1367 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:43.843734 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:43.877301 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-73c5311f-e11d-4c61-9ade-267177903966 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:43.878350 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-73c5311f-e11d-4c61-9ade-267177903966 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:43.911868 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:43.918360 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-73c5311f-e11d-4c61-9ade-267177903966 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:43.918858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-73c5311f-e11d-4c61-9ade-267177903966 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:43.919301 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-73c5311f-e11d-4c61-9ade-267177903966 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:43.920053 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-73c5311f-e11d-4c61-9ade-267177903966 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:43.920548 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-73c5311f-e11d-4c61-9ade-267177903966 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:43.924347 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:43.929519 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-73c5311f-e11d-4c61-9ade-267177903966 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:43.932790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b8c25220-b305-4d84-921b-25b430cc7e92 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 1.091092 Aug 31 00:23:43.933596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 169/347] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:42 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:43.960805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:44.608426 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d4ea4598-262c-45ca-97a7-f74d8163bdaf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:44.609225 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d4ea4598-262c-45ca-97a7-f74d8163bdaf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:44.631327 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4ea4598-262c-45ca-97a7-f74d8163bdaf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:44.637442 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4ea4598-262c-45ca-97a7-f74d8163bdaf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:44.638437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4ea4598-262c-45ca-97a7-f74d8163bdaf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:44.642917 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4ea4598-262c-45ca-97a7-f74d8163bdaf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:44.644426 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4ea4598-262c-45ca-97a7-f74d8163bdaf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:44.645044 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4ea4598-262c-45ca-97a7-f74d8163bdaf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:44.719854 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-73c5311f-e11d-4c61-9ade-267177903966 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:44.734186 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-73c5311f-e11d-4c61-9ade-267177903966 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1471 microversion: 2.1 time: 0.865028 Aug 31 00:23:44.738758 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 179/348] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:43 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1471 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:44.979206 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:44.981733 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:44.997147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.005744 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.011687 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.012770 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.013507 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.014195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.262793 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d4ea4598-262c-45ca-97a7-f74d8163bdaf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:45.281431 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d4ea4598-262c-45ca-97a7-f74d8163bdaf tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1557 microversion: 2.1 time: 0.678008 Aug 31 00:23:45.296189 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 170/349] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:44 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1557 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:45.296189 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-0fe76a3b-b675-4964-bd77-a64544dd4493 req-fdb15bf5-053f-4a76-973a-5dfd88dff747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d2b6c3-d9bd-46e8-a283-09a45974f0ab", "name": "network-vif-deleted", "tag": "8f3f1405-2fc5-4b5e-aa6d-8b4237256828"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:45.315797 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-0fe76a3b-b675-4964-bd77-a64544dd4493 req-fdb15bf5-053f-4a76-973a-5dfd88dff747 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.315797 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-0fe76a3b-b675-4964-bd77-a64544dd4493 req-fdb15bf5-053f-4a76-973a-5dfd88dff747 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.315797 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-0fe76a3b-b675-4964-bd77-a64544dd4493 req-fdb15bf5-053f-4a76-973a-5dfd88dff747 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.351018 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-0fe76a3b-b675-4964-bd77-a64544dd4493 req-fdb15bf5-053f-4a76-973a-5dfd88dff747 service nova] Creating event network-vif-deleted:8f3f1405-2fc5-4b5e-aa6d-8b4237256828 for instance c7d2b6c3-d9bd-46e8-a283-09a45974f0ab on hv-cinder-85221 Aug 31 00:23:45.363459 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-0fe76a3b-b675-4964-bd77-a64544dd4493 req-fdb15bf5-053f-4a76-973a-5dfd88dff747 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079550 Aug 31 00:23:45.364473 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 171/350] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:45.392897 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b51e2467-342b-4abe-862c-3fd9d996f2a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:45.393925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b51e2467-342b-4abe-862c-3fd9d996f2a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:45.412597 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b51e2467-342b-4abe-862c-3fd9d996f2a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.414138 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b51e2467-342b-4abe-862c-3fd9d996f2a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.414797 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b51e2467-342b-4abe-862c-3fd9d996f2a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.415755 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b51e2467-342b-4abe-862c-3fd9d996f2a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.419334 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b51e2467-342b-4abe-862c-3fd9d996f2a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.420266 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b51e2467-342b-4abe-862c-3fd9d996f2a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.877277 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b51e2467-342b-4abe-862c-3fd9d996f2a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.510682 Aug 31 00:23:45.878464 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 172/351] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 31 00:23:45 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5/os-interface => generated 284 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:45.893182 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9378f020-3790-4d08-b1f8-e46f0c334dd0 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:45.894109 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9378f020-3790-4d08-b1f8-e46f0c334dd0 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:45.910023 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9378f020-3790-4d08-b1f8-e46f0c334dd0 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.910814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9378f020-3790-4d08-b1f8-e46f0c334dd0 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.911431 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9378f020-3790-4d08-b1f8-e46f0c334dd0 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.912363 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9378f020-3790-4d08-b1f8-e46f0c334dd0 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.912989 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9378f020-3790-4d08-b1f8-e46f0c334dd0 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.913634 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9378f020-3790-4d08-b1f8-e46f0c334dd0 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:46.102122 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:46.133450 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:46.143812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:46.147309 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e3b46df9-3147-40ce-8b7d-c46e672ae46c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 1.172153 Aug 31 00:23:46.151198 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 180/352] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:44 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:46.480137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9378f020-3790-4d08-b1f8-e46f0c334dd0 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:46.499759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9378f020-3790-4d08-b1f8-e46f0c334dd0 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1300 microversion: 2.1 time: 0.611013 Aug 31 00:23:46.503124 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 173/353] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:45 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1300 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:47.203097 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:47.204057 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:47.220051 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:47.222993 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:47.226972 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:47.231492 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:47.233068 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:47.235647 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:47.455652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f96f9477-58bb-4d84-ab86-920b0ac7429e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Action: 'create', calling method: .version_select at 0x7f1a3ad6d310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1834305697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2KGFKIOK7xx5dUtz3LnyQL366kpKJzETHTs6WnCGV8fKCzd6/XhCiL/77k4zBc1oztY4mmnnGGyGWmuch72WcIV+lKtXqjLPghqyLdaIvl8auOQ8CSd/Gx3YG/7/lgDw=="}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:47.478942 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-f96f9477-58bb-4d84-ab86-920b0ac7429e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Getting quotas for project 81666ce8589a4e45ac7f5f9e6e6cc9a3. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:23:47.485529 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-f96f9477-58bb-4d84-ab86-920b0ac7429e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Getting quotas for user 213a798609294cb3ab6e0312ddbb1024 and project 81666ce8589a4e45ac7f5f9e6e6cc9a3. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:23:47.534376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f96f9477-58bb-4d84-ab86-920b0ac7429e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.461240 Aug 31 00:23:47.541052 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 181/354] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 31 00:23:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:23:47.585434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:47.590080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:47.632332 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:47.636135 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:47.640091 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:47.645656 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:47.649581 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:47.655290 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:47.855706 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:47.875331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:47.876534 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:47.877652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lazy-loading 'fault' on Instance uuid c7d2b6c3-d9bd-46e8-a283-09a45974f0ab {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:48.231920 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:48.265715 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5bd263e1-b115-4ebf-8f75-00ef1f41dfed tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1305 microversion: 2.1 time: 0.704946 Aug 31 00:23:48.268829 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 182/355] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:47 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1305 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:48.993078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:49.008672 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:49.011056 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:49.012768 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3afc51f5-addf-4685-b5c6-e1332701e2aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 1.816894 Aug 31 00:23:49.023414 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 174/356] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:47 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:23:49.296032 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:49.297099 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:49.309457 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:49.310158 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:49.310871 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:49.312307 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:49.313412 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:49.313966 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:49.379811 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:49.381098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:49.382092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:49.383366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lazy-loading 'fault' on Instance uuid c7d2b6c3-d9bd-46e8-a283-09a45974f0ab {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:49.526601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:49.555661 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-47b7842b-e1da-4424-ae60-b52faa0e3bf5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1305 microversion: 2.1 time: 0.266967 Aug 31 00:23:49.567575 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 183/357] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:49 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1305 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:50.037791 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:50.039288 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:50.053895 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.054715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.055341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.056334 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.059714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.060493 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.461431 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:50.480255 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:50.482357 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:50.483696 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2b5a6ec5-c6c3-4e74-9038-a496cb78c5b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.449834 Aug 31 00:23:50.484346 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 175/358] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:50 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:50.581143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:50.582626 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:50.607081 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.608392 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.609587 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.611789 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.612930 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.614036 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.679091 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.680574 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.681776 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.682676 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lazy-loading 'fault' on Instance uuid c7d2b6c3-d9bd-46e8-a283-09a45974f0ab {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:50.772975 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:50.820445 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d6050b85-9a1b-41bd-9caa-fd7c2e0143e6 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1305 microversion: 2.1 time: 0.245849 Aug 31 00:23:50.832189 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 184/359] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:50 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1305 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:50.842585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-f607a659-69ff-4f11-b968-d95a4d247dca req-14b2322c-4c4a-4452-b365-80226512b429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fdf4278-aa30-4d1a-8c4d-94afd592aba5", "tag": "045ec9e3-1f50-4880-9a45-e10e1bd6b41b"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:50.861470 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f607a659-69ff-4f11-b968-d95a4d247dca req-14b2322c-4c4a-4452-b365-80226512b429 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.861975 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f607a659-69ff-4f11-b968-d95a4d247dca req-14b2322c-4c4a-4452-b365-80226512b429 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.862423 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f607a659-69ff-4f11-b968-d95a4d247dca req-14b2322c-4c4a-4452-b365-80226512b429 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.880041 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-f607a659-69ff-4f11-b968-d95a4d247dca req-14b2322c-4c4a-4452-b365-80226512b429 service nova] Creating event network-changed:045ec9e3-1f50-4880-9a45-e10e1bd6b41b for instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 on hv-cinder-85221 Aug 31 00:23:50.899284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-f607a659-69ff-4f11-b968-d95a4d247dca req-14b2322c-4c4a-4452-b365-80226512b429 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059309 Aug 31 00:23:50.902486 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 176/360] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:51.527062 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:51.527687 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:51.546592 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:51.547198 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:51.547642 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:51.552526 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:51.553203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:51.560424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:51.848781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:51.849660 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:51.870328 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:51.873130 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:51.876742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:51.880130 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:51.883989 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:51.886441 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:51.980728 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:52.021833 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:52.025481 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:52.028085 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ed16be13-4d8b-4d18-9d82-e3018467077d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.505809 Aug 31 00:23:52.030263 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 185/361] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:51 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:23:52.060345 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:52.064843 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:52.065547 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:52.067963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lazy-loading 'fault' on Instance uuid c7d2b6c3-d9bd-46e8-a283-09a45974f0ab {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:52.170575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:52.188848 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-bd24c226-e398-456c-be29-7a98030d4a6a tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1305 microversion: 2.1 time: 0.346585 Aug 31 00:23:52.189962 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 177/362] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:51 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1305 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:53.070610 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:53.071707 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:53.109397 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:53.112508 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:53.113685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:53.117251 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:53.119377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:53.120616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:53.261249 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:53.262233 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:53.306984 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:53.315180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:53.323766 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:53.324628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:53.325465 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:53.340515 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:53.416453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:53.503024 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:53.504865 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:53.506193 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:53.507232 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lazy-loading 'fault' on Instance uuid c7d2b6c3-d9bd-46e8-a283-09a45974f0ab {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:53.660742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:53.693495 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-396e4ab7-d778-4211-8b6e-47fa6f72cd8e tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1305 microversion: 2.1 time: 0.437035 Aug 31 00:23:53.695426 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 178/363] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:53 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1305 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:53.828263 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:53.891294 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:53.897957 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:53.899461 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-02fb8f12-535f-465a-b6d1-fe80a50711f6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.837467 Aug 31 00:23:53.901681 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 186/364] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:53 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:54.718526 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:54.719431 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:54.728504 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:54.729090 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:54.729691 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:54.730530 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:54.731059 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:54.731770 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:54.769697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:54.770119 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:54.770561 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:54.771028 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lazy-loading 'fault' on Instance uuid c7d2b6c3-d9bd-46e8-a283-09a45974f0ab {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:54.823085 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:54.838423 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-089aca45-29d3-431b-9844-f52db0627c95 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1305 microversion: 2.1 time: 0.125182 Aug 31 00:23:54.839500 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 179/365] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:54 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1305 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:54.944823 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:54.945757 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:54.953522 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:54.954014 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:54.954521 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:54.955512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:54.956009 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:54.956469 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:55.175732 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:55.186074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:55.187776 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:55.189730 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-deeeeeda-626b-436d-9b88-8da1a8e126e1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.251711 Aug 31 00:23:55.190585 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 187/366] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:54 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:55.873630 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:55.874557 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:55.883245 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:55.884108 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:55.884962 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:55.886245 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:55.887029 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:55.887634 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:55.928237 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:55.928739 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:55.929181 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:55.929641 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lazy-loading 'fault' on Instance uuid c7d2b6c3-d9bd-46e8-a283-09a45974f0ab {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:55.978936 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:56.029303 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-91f1a0a5-76f6-4660-9b5f-454e731a7319 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1305 microversion: 2.1 time: 0.159926 Aug 31 00:23:56.030153 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 180/367] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:55 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1305 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:56.229960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:56.230644 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:56.239933 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:56.240636 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:56.241200 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:56.242023 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:56.242587 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:56.243114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:56.410184 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:56.423914 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:56.426731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:56.428942 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3b08770b-736b-4829-89b2-216f0585cb53 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.202661 Aug 31 00:23:56.429811 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 188/368] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:56 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:57.068628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:57.070173 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:57.080082 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:57.081403 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:57.082172 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:57.083700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:57.084904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:57.085662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:57.160299 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:57.161218 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:57.162064 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:57.162885 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lazy-loading 'fault' on Instance uuid c7d2b6c3-d9bd-46e8-a283-09a45974f0ab {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:57.247993 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a26318c91b4976970c88d3c967ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e164298f9d449498f1c7b4c06a839be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:57.260861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a9ad22af-9f9d-43ff-9b67-0f0fb71d738f tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 200 len: 1305 microversion: 2.1 time: 0.196649 Aug 31 00:23:57.262154 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 181/369] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:57 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 1305 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:57.457038 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:57.458203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:57.473035 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:57.473678 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:57.474311 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:57.475187 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:57.475907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:57.476484 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:57.505040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=4 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:57.696393 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:57.714645 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:57.718629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:57.721035 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-faf86cab-6243-41b9-9b5c-fe6a67baf781 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.269156 Aug 31 00:23:57.724696 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 189/370] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:57 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:23:58.297433 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:58.298111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] [instance: c7d2b6c3-d9bd-46e8-a283-09a45974f0ab] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:58.306076 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:58.306566 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:58.307005 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:58.307725 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:58.308204 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:58.308636 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:58.324145 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] HTTP exception thrown: Instance c7d2b6c3-d9bd-46e8-a283-09a45974f0ab could not be found. Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Request method failure captured: Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab HTTP/1.1 Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqni8SZYL347FS3C0TL_c7ajH_Xsm7Y8qk0pg69R3nKQfdnUdDxpIGvU_BroJyx_VfQlTtVU6YSC1Yn7CBg7sN6LQei6SFKwkuwiXjKBSUL9ujvPU4HE17OgkoWfXX-zw0_EWo0KpGlymh-i-BEseFJWR7xcgepnaslLRksasZ-X4Jo Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: 9e164298f9d449498f1c7b4c06a839be Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-VolumesNegativeTest-256931114 Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:23:58.325920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9e164298f9d449498f1c7b4c06a839be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e164298f9d449498f1c7b4c06a839be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e164298f9d449498f1c7b4c06a839be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9e164298f9d449498f1c7b4c06a839be"}]}] Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-VolumesNegativeTest-256931114 Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: 9e164298f9d449498f1c7b4c06a839be Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-VolumesNegativeTest-256931114 Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-VolumesNegativeTest-256931114-project Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: 46a26318c91b4976970c88d3c967ca10 Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-VolumesNegativeTest-256931114-project Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance c7d2b6c3-d9bd-46e8-a283-09a45974f0ab could not be found. Aug 31 00:23:58.329715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': 'c7d2b6c3-d9bd-46e8-a283-09a45974f0ab'} Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d2b6c3-d9bd-46e8-a283-09a45974f0ab could not be found. Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:23:58.332190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d2b6c3-d9bd-46e8-a283-09a45974f0ab could not be found. Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d2b6c3-d9bd-46e8-a283-09a45974f0ab could not be found. Aug 31 00:23:58.334759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:23:58.340272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] Returning 404 to user: Instance c7d2b6c3-d9bd-46e8-a283-09a45974f0ab could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:23:58.340272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b82c5fb7-c991-49a0-a2b2-23c04287c8c5 tempest-VolumesNegativeTest-256931114 tempest-VolumesNegativeTest-256931114-project] 10.222.0.47 "GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab" status: 404 len: 111 microversion: 2.1 time: 0.035077 Aug 31 00:23:58.340272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 182/371] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:58 2022] GET /compute/v2.1/servers/c7d2b6c3-d9bd-46e8-a283-09a45974f0ab => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:23:58.757932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:58.758736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:58.765602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:58.766284 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:58.767120 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:58.767602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:58.768066 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:58.768538 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:59.013019 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:59.032197 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:59.036847 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:59.038680 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5b88baa7-fc91-4617-94d6-12f2672f686c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.286927 Aug 31 00:23:59.039443 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 190/372] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:23:58 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:24:00.075897 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:00.077179 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:00.091251 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:00.092128 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:00.092905 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:00.094256 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:00.095547 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:00.096334 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:00.326970 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:00.339215 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:00.340750 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:00.341986 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-47edc305-d628-419f-bf81-1e38b1930369 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.278356 Aug 31 00:24:00.342569 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 183/373] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:00 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:01.353970 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d5b0c7b3-fefa-415d-87ca-67fd32a8168f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:01.354732 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d5b0c7b3-fefa-415d-87ca-67fd32a8168f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:01.357522 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:01.367432 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:01.368373 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:01.376000 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5b0c7b3-fefa-415d-87ca-67fd32a8168f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:01.377064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5b0c7b3-fefa-415d-87ca-67fd32a8168f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:01.377627 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5b0c7b3-fefa-415d-87ca-67fd32a8168f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:01.378306 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:01.378462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5b0c7b3-fefa-415d-87ca-67fd32a8168f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:01.378955 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5b0c7b3-fefa-415d-87ca-67fd32a8168f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:01.379158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:01.379499 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5b0c7b3-fefa-415d-87ca-67fd32a8168f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:01.379943 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:01.381298 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:01.382332 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:01.382917 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:01.617269 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:01.628077 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:01.629128 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-d5b0c7b3-fefa-415d-87ca-67fd32a8168f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lazy-loading 'services' on Instance uuid 1e22ddf8-4065-4933-a8db-68b53f82a42e {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:01.629790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:01.631667 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2a4e40e1-eff8-4ed2-8993-61e48e8b83fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.268924 Aug 31 00:24:01.632288 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 184/374] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:01 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:01.809408 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d5b0c7b3-fefa-415d-87ca-67fd32a8168f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/os-volume_attachments/4066e108-dc69-4e45-bdbd-a947e3c648df" status: 202 len: 0 microversion: 2.1 time: 0.460572 Aug 31 00:24:01.811021 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 191/375] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:24:01 2022] DELETE /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/os-volume_attachments/4066e108-dc69-4e45-bdbd-a947e3c648df => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:24:02.665865 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:02.666864 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:02.674630 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:02.675168 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:02.675687 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:02.676673 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:02.677678 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:02.677989 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:02.827798 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:02.839290 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:02.840873 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:02.842118 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-edaa6871-6f7b-456b-a02b-2cd449efa8b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.180686 Aug 31 00:24:02.842691 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 185/376] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:02 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:03.872656 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:03.873561 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:03.881374 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:03.881975 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:03.882500 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:03.883320 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:03.883867 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:03.884432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:04.122346 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:04.133130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:04.134514 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:04.135892 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-86d3d348-a539-4ad2-a7f4-69252ce490b3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.268604 Aug 31 00:24:04.136503 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 192/377] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:03 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:24:05.183076 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:05.184200 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:05.193555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:05.194159 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:05.194843 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:05.196074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:05.196999 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:05.197724 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:05.397096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:05.413858 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:05.416996 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:05.419133 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-10f15bae-49b9-4222-a51b-b774e04418e2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.241075 Aug 31 00:24:05.420504 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 186/378] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:05 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:24:06.456267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:06.456967 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:06.465185 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:06.465877 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:06.466588 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:06.467367 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:06.467976 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:06.468621 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:06.662557 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:06.680160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:06.683262 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:06.685440 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-84a410d2-a1df-4d35-992c-c028f39f9f12 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.238271 Aug 31 00:24:06.686459 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 193/379] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:06 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:07.339867 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b9083ab9-ff8d-489d-8b18-c51bad6f9d2b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:07.347398 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b9083ab9-ff8d-489d-8b18-c51bad6f9d2b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.347928 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b9083ab9-ff8d-489d-8b18-c51bad6f9d2b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.348477 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b9083ab9-ff8d-489d-8b18-c51bad6f9d2b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.373967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b9083ab9-ff8d-489d-8b18-c51bad6f9d2b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Going to try to stop instance {{(pid=127117) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 00:24:07.426074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b9083ab9-ff8d-489d-8b18-c51bad6f9d2b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "POST /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/action" status: 202 len: 0 microversion: 2.1 time: 0.090052 Aug 31 00:24:07.427081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 187/380] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:24:07 2022] POST /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:24:07.441447 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e7dc0de8-b773-4508-b1c4-4e28b57d9696 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:07.442638 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e7dc0de8-b773-4508-b1c4-4e28b57d9696 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:07.453865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e7dc0de8-b773-4508-b1c4-4e28b57d9696 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.455388 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e7dc0de8-b773-4508-b1c4-4e28b57d9696 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.456209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e7dc0de8-b773-4508-b1c4-4e28b57d9696 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.457818 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e7dc0de8-b773-4508-b1c4-4e28b57d9696 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.458650 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e7dc0de8-b773-4508-b1c4-4e28b57d9696 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.459441 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e7dc0de8-b773-4508-b1c4-4e28b57d9696 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.701168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e7dc0de8-b773-4508-b1c4-4e28b57d9696 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:07.711691 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e7dc0de8-b773-4508-b1c4-4e28b57d9696 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.278767 Aug 31 00:24:07.712381 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 194/381] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:07 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:07.731421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:07.732682 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:07.744509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.745399 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.746182 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.747447 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.748374 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.749078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.925715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:07.935510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:07.937007 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:07.938210 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f6d8d4ad-91e7-4b4f-8654-15577fd79cc8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.214898 Aug 31 00:24:07.939932 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 188/382] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:07 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:08.734793 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-269eecf1-5179-4b5f-8337-7a2eb1a0effb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:08.736319 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-269eecf1-5179-4b5f-8337-7a2eb1a0effb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:08.742735 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-269eecf1-5179-4b5f-8337-7a2eb1a0effb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.743224 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-269eecf1-5179-4b5f-8337-7a2eb1a0effb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.743656 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-269eecf1-5179-4b5f-8337-7a2eb1a0effb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.744552 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-269eecf1-5179-4b5f-8337-7a2eb1a0effb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.745137 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-269eecf1-5179-4b5f-8337-7a2eb1a0effb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.745586 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-269eecf1-5179-4b5f-8337-7a2eb1a0effb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.748914 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:08.940984 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-269eecf1-5179-4b5f-8337-7a2eb1a0effb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:08.949663 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-269eecf1-5179-4b5f-8337-7a2eb1a0effb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.219008 Aug 31 00:24:08.950263 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 195/383] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:08 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:08.965651 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:08.966399 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:08.973896 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.974516 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.975023 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.975819 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.976396 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.976900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:09.137439 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:09.153030 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:09.156041 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:09.158907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ace54ce1-2340-46c3-a07d-0be35b070c9c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.199058 Aug 31 00:24:09.164434 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 189/384] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:08 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:09.986169 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a6821572-644f-4220-8b8c-d1480b72b534 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:09.986931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a6821572-644f-4220-8b8c-d1480b72b534 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:09.995474 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a6821572-644f-4220-8b8c-d1480b72b534 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.995967 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a6821572-644f-4220-8b8c-d1480b72b534 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.996441 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a6821572-644f-4220-8b8c-d1480b72b534 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:09.997168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a6821572-644f-4220-8b8c-d1480b72b534 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.997623 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a6821572-644f-4220-8b8c-d1480b72b534 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.998074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a6821572-644f-4220-8b8c-d1480b72b534 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:10.153123 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a6821572-644f-4220-8b8c-d1480b72b534 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:10.162138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a6821572-644f-4220-8b8c-d1480b72b534 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.181048 Aug 31 00:24:10.162822 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 196/385] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:09 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:10.190873 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:10.191557 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:10.199436 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:10.200346 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:10.200845 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:10.201675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:10.202289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:10.202929 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:10.351962 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:10.362425 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:10.363920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:10.365183 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5dee47c9-b423-464c-8bb8-ce7de8c41193 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.179585 Aug 31 00:24:10.365763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 190/386] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:10 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:11.034979 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-a7827557-2bf0-4f74-bd83-67f32e60b767 req-b67e47cc-6aa4-462a-b304-6c61ea167025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a312d8-6cb2-4da8-a19b-215372294799", "name": "network-vif-plugged", "status": "completed", "tag": "0ff0dbfa-0c17-4d1f-bc12-fdd58530b639"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:11.053871 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-a7827557-2bf0-4f74-bd83-67f32e60b767 req-b67e47cc-6aa4-462a-b304-6c61ea167025 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.054686 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-a7827557-2bf0-4f74-bd83-67f32e60b767 req-b67e47cc-6aa4-462a-b304-6c61ea167025 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.055450 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-a7827557-2bf0-4f74-bd83-67f32e60b767 req-b67e47cc-6aa4-462a-b304-6c61ea167025 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.077889 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-a7827557-2bf0-4f74-bd83-67f32e60b767 req-b67e47cc-6aa4-462a-b304-6c61ea167025 service nova] Creating event network-vif-plugged:0ff0dbfa-0c17-4d1f-bc12-fdd58530b639 for instance e3a312d8-6cb2-4da8-a19b-215372294799 on hv-cinder-85221 Aug 31 00:24:11.088054 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-a7827557-2bf0-4f74-bd83-67f32e60b767 req-b67e47cc-6aa4-462a-b304-6c61ea167025 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061094 Aug 31 00:24:11.089182 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 197/387] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:11.192451 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8acb994a-3de0-4503-a14d-93580dda5da4 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:11.193163 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8acb994a-3de0-4503-a14d-93580dda5da4 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:11.196662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=57 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:11.203195 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8acb994a-3de0-4503-a14d-93580dda5da4 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.203794 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8acb994a-3de0-4503-a14d-93580dda5da4 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.205215 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8acb994a-3de0-4503-a14d-93580dda5da4 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.205963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8acb994a-3de0-4503-a14d-93580dda5da4 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.206851 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8acb994a-3de0-4503-a14d-93580dda5da4 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.207516 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8acb994a-3de0-4503-a14d-93580dda5da4 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.390789 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:11.392704 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:11.400637 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.401154 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.401575 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.402317 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.402779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.403206 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.406546 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8acb994a-3de0-4503-a14d-93580dda5da4 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:11.417317 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8acb994a-3de0-4503-a14d-93580dda5da4 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.228978 Aug 31 00:24:11.417929 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 191/388] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:11 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:11.572353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:11.583516 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:11.585508 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:11.587070 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-948e4db0-e7a5-4c58-a819-3692ffc8ceff tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.201070 Aug 31 00:24:11.587731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 198/389] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:11 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:24:12.443676 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ee30a5c6-ebd8-4083-b6bd-994164558bc1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:12.444540 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ee30a5c6-ebd8-4083-b6bd-994164558bc1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:12.455861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ee30a5c6-ebd8-4083-b6bd-994164558bc1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.456762 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ee30a5c6-ebd8-4083-b6bd-994164558bc1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.457534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ee30a5c6-ebd8-4083-b6bd-994164558bc1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.458795 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ee30a5c6-ebd8-4083-b6bd-994164558bc1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.459600 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ee30a5c6-ebd8-4083-b6bd-994164558bc1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.460397 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ee30a5c6-ebd8-4083-b6bd-994164558bc1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.627985 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:12.629146 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:12.635029 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ee30a5c6-ebd8-4083-b6bd-994164558bc1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:12.641127 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.642530 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.643301 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.644538 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ee30a5c6-ebd8-4083-b6bd-994164558bc1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.207689 Aug 31 00:24:12.644763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.645628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.645852 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 192/390] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:12 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:12.646404 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.831753 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:12.841422 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:12.842880 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:12.844091 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-88f22260-487c-4142-ac81-8f1f142c2d74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.223347 Aug 31 00:24:12.844744 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 199/391] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:12 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:13.672220 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a211ee09-7a75-48b0-b7e1-ae475b4d8ef0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:13.673469 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-a211ee09-7a75-48b0-b7e1-ae475b4d8ef0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:13.685084 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a211ee09-7a75-48b0-b7e1-ae475b4d8ef0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:13.685967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a211ee09-7a75-48b0-b7e1-ae475b4d8ef0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:13.686749 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a211ee09-7a75-48b0-b7e1-ae475b4d8ef0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.687975 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a211ee09-7a75-48b0-b7e1-ae475b4d8ef0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:13.689459 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a211ee09-7a75-48b0-b7e1-ae475b4d8ef0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:13.690209 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a211ee09-7a75-48b0-b7e1-ae475b4d8ef0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.714821 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:13.867974 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:13.868829 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:13.879856 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:13.880491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:13.880939 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.881707 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:13.882168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:13.882601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.903365 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a211ee09-7a75-48b0-b7e1-ae475b4d8ef0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:13.916840 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a211ee09-7a75-48b0-b7e1-ae475b4d8ef0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.251371 Aug 31 00:24:13.917930 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 193/392] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:13 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:14.057691 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:14.068504 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:14.069860 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:14.071053 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-45466c57-5392-45ae-bda2-da51d94fc379 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.207849 Aug 31 00:24:14.071695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 200/393] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:13 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:24:14.955521 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5ab13f1e-f7cb-4b05-8068-4ec967e34fd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:14.956570 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5ab13f1e-f7cb-4b05-8068-4ec967e34fd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:14.964856 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5ab13f1e-f7cb-4b05-8068-4ec967e34fd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.965492 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5ab13f1e-f7cb-4b05-8068-4ec967e34fd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.966096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5ab13f1e-f7cb-4b05-8068-4ec967e34fd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.966891 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5ab13f1e-f7cb-4b05-8068-4ec967e34fd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.967461 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5ab13f1e-f7cb-4b05-8068-4ec967e34fd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.968223 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5ab13f1e-f7cb-4b05-8068-4ec967e34fd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.098226 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:15.099750 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:15.107828 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.108666 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.109165 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.109981 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.110822 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.111451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.136986 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5ab13f1e-f7cb-4b05-8068-4ec967e34fd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:15.146700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5ab13f1e-f7cb-4b05-8068-4ec967e34fd5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.196038 Aug 31 00:24:15.147475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 194/394] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:14 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:15.293905 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:15.304775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:15.306364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:15.308875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2b459d9c-a2a1-431d-877e-3743764f9535 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.216393 Aug 31 00:24:15.308875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 201/395] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:15 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:16.187941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d8d3f4fb-52f5-49aa-a43e-bd4a530ce80b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:16.190240 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d8d3f4fb-52f5-49aa-a43e-bd4a530ce80b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:16.202833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d8d3f4fb-52f5-49aa-a43e-bd4a530ce80b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.203666 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d8d3f4fb-52f5-49aa-a43e-bd4a530ce80b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.204879 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d8d3f4fb-52f5-49aa-a43e-bd4a530ce80b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.206868 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d8d3f4fb-52f5-49aa-a43e-bd4a530ce80b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.207751 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d8d3f4fb-52f5-49aa-a43e-bd4a530ce80b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.208765 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d8d3f4fb-52f5-49aa-a43e-bd4a530ce80b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.336786 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:16.338050 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:16.363577 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.364739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.366780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.369354 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.370759 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.372348 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.452201 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d8d3f4fb-52f5-49aa-a43e-bd4a530ce80b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:16.467877 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d8d3f4fb-52f5-49aa-a43e-bd4a530ce80b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.288621 Aug 31 00:24:16.469375 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 195/396] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:16 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:16.639445 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:16.664593 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:16.667710 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:16.669453 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2a751b8e-a7ec-4733-8bd9-ede14a655cba tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1807 microversion: 2.20 time: 0.340853 Aug 31 00:24:16.670567 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 202/397] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:16 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1807 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:17.321646 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-69076641", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1834305697", "security_groups": [{"name": "tempest-secgroup-smoke-935473032"}], "networks": [{"uuid": "3f3c2a3c-500d-4a27-8cc3-ff83980a9b39"}], "block_device_mapping_v2": [{"uuid": "50d93475-5127-4a9e-9600-5d35ecb79367", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:17.495570 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-6a0f86fe-3f30-4518-a0c5-fec1c954e74e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:17.496663 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-6a0f86fe-3f30-4518-a0c5-fec1c954e74e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:17.506468 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6a0f86fe-3f30-4518-a0c5-fec1c954e74e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.507220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6a0f86fe-3f30-4518-a0c5-fec1c954e74e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.507950 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6a0f86fe-3f30-4518-a0c5-fec1c954e74e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.509047 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6a0f86fe-3f30-4518-a0c5-fec1c954e74e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.509834 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6a0f86fe-3f30-4518-a0c5-fec1c954e74e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.510725 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6a0f86fe-3f30-4518-a0c5-fec1c954e74e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.741644 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] validate_networks() for [('3f3c2a3c-500d-4a27-8cc3-ff83980a9b39', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:24:17.910472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-6a0f86fe-3f30-4518-a0c5-fec1c954e74e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:17.919968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-6a0f86fe-3f30-4518-a0c5-fec1c954e74e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.429733 Aug 31 00:24:17.935367 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 203/398] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:17 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:17.942328 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:17.943012 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:17.950938 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.951498 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.952250 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.953329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.954765 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.955179 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:18.242980 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:18.261673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:18.266332 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:18.269057 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8d512896-ca6b-442f-b0b1-349af62e7bf3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1794 microversion: 2.20 time: 0.331798 Aug 31 00:24:18.270491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 204/399] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:17 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1794 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:18.491232 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1ebde5dc-d565-4139-8fa5-cd8461c38c2b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:18.491868 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1ebde5dc-d565-4139-8fa5-cd8461c38c2b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:18.499981 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ebde5dc-d565-4139-8fa5-cd8461c38c2b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:18.501683 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ebde5dc-d565-4139-8fa5-cd8461c38c2b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:18.502621 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ebde5dc-d565-4139-8fa5-cd8461c38c2b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:18.503754 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ebde5dc-d565-4139-8fa5-cd8461c38c2b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:18.504642 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ebde5dc-d565-4139-8fa5-cd8461c38c2b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:18.505234 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ebde5dc-d565-4139-8fa5-cd8461c38c2b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:18.512032 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:24:18.513612 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:24:18.515631 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:24:18.516934 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:24:18.517752 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:24:18.535404 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:18.536712 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:18.537662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:18.539316 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:18.540458 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:18.541390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:18.586316 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Getting quotas for project 81666ce8589a4e45ac7f5f9e6e6cc9a3. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:24:18.597531 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Getting quotas for user 213a798609294cb3ab6e0312ddbb1024 and project 81666ce8589a4e45ac7f5f9e6e6cc9a3. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:24:18.664873 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-1ebde5dc-d565-4139-8fa5-cd8461c38c2b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lazy-loading 'services' on Instance uuid 166c7ed8-54c6-4829-8e41-217e47eaecb7 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:18.680780 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:24:18.683301 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50d93475-5127-4a9e-9600-5d35ecb79367',volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:24:18.790357 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1ebde5dc-d565-4139-8fa5-cd8461c38c2b tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "DELETE /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7/os-volume_attachments/665b75af-e90f-4415-ae02-5593d166edde" status: 202 len: 0 microversion: 2.1 time: 0.305984 Aug 31 00:24:18.791681 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 205/400] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:24:18 2022] DELETE /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7/os-volume_attachments/665b75af-e90f-4415-ae02-5593d166edde => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:24:18.914686 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-0df8301d-90c7-4e01-aba8-82315f9f6bf3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.597073 Aug 31 00:24:18.916234 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 196/401] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:24:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:24:18.937795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-87b8e683-ea72-425e-8e2f-94edef433645 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:18.938055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-87b8e683-ea72-425e-8e2f-94edef433645 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:18.945593 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9490091a-e4b7-4d57-88b7-156e22763a62 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:18.948529 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9490091a-e4b7-4d57-88b7-156e22763a62 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:18.963808 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9490091a-e4b7-4d57-88b7-156e22763a62 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:18.964778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9490091a-e4b7-4d57-88b7-156e22763a62 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:18.965569 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9490091a-e4b7-4d57-88b7-156e22763a62 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:18.966894 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9490091a-e4b7-4d57-88b7-156e22763a62 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:18.967727 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9490091a-e4b7-4d57-88b7-156e22763a62 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:18.968599 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9490091a-e4b7-4d57-88b7-156e22763a62 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:19.035459 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-87b8e683-ea72-425e-8e2f-94edef433645 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:19.049842 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-87b8e683-ea72-425e-8e2f-94edef433645 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1087 microversion: 2.1 time: 0.119147 Aug 31 00:24:19.051261 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 206/402] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:18 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1087 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:19.206165 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9490091a-e4b7-4d57-88b7-156e22763a62 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:19.215155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9490091a-e4b7-4d57-88b7-156e22763a62 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.275254 Aug 31 00:24:19.215924 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 197/403] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:18 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:20.086790 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4811347b-7f7b-49b5-a6a7-fde03373f222 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:20.087798 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4811347b-7f7b-49b5-a6a7-fde03373f222 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:20.096812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4811347b-7f7b-49b5-a6a7-fde03373f222 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.097491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4811347b-7f7b-49b5-a6a7-fde03373f222 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.098081 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4811347b-7f7b-49b5-a6a7-fde03373f222 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.098964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4811347b-7f7b-49b5-a6a7-fde03373f222 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.099930 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4811347b-7f7b-49b5-a6a7-fde03373f222 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.100546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4811347b-7f7b-49b5-a6a7-fde03373f222 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.203613 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4811347b-7f7b-49b5-a6a7-fde03373f222 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:20.219061 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4811347b-7f7b-49b5-a6a7-fde03373f222 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1185 microversion: 2.1 time: 0.137807 Aug 31 00:24:20.221064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 207/404] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:20 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:20.239178 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b89be9a2-3d67-4e28-a8a5-a230567764aa tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:20.239910 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b89be9a2-3d67-4e28-a8a5-a230567764aa tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:20.248934 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b89be9a2-3d67-4e28-a8a5-a230567764aa tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.249460 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b89be9a2-3d67-4e28-a8a5-a230567764aa tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.249959 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b89be9a2-3d67-4e28-a8a5-a230567764aa tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.250759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b89be9a2-3d67-4e28-a8a5-a230567764aa tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.251204 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b89be9a2-3d67-4e28-a8a5-a230567764aa tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.251666 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b89be9a2-3d67-4e28-a8a5-a230567764aa tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.425491 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b89be9a2-3d67-4e28-a8a5-a230567764aa tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:20.433904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b89be9a2-3d67-4e28-a8a5-a230567764aa tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.199210 Aug 31 00:24:20.434550 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 198/405] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:20 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:21.176779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4f238666-b09a-4d4b-bcc0-796d11d46c8a tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:21.177395 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4f238666-b09a-4d4b-bcc0-796d11d46c8a tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:21.184638 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4f238666-b09a-4d4b-bcc0-796d11d46c8a tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.185145 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4f238666-b09a-4d4b-bcc0-796d11d46c8a tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.185573 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4f238666-b09a-4d4b-bcc0-796d11d46c8a tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.186297 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4f238666-b09a-4d4b-bcc0-796d11d46c8a tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.186752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4f238666-b09a-4d4b-bcc0-796d11d46c8a tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.187174 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4f238666-b09a-4d4b-bcc0-796d11d46c8a tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.222724 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4f238666-b09a-4d4b-bcc0-796d11d46c8a tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Going to try to terminate instance {{(pid=127118) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:24:21.258318 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-004e949e-f048-4089-b707-5c122e56e0ea tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:21.259169 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-004e949e-f048-4089-b707-5c122e56e0ea tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:21.270632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-004e949e-f048-4089-b707-5c122e56e0ea tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.271137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-004e949e-f048-4089-b707-5c122e56e0ea tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.271581 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-004e949e-f048-4089-b707-5c122e56e0ea tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.273014 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-004e949e-f048-4089-b707-5c122e56e0ea tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.274018 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-004e949e-f048-4089-b707-5c122e56e0ea tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.274677 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-004e949e-f048-4089-b707-5c122e56e0ea tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.368076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4f238666-b09a-4d4b-bcc0-796d11d46c8a tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "DELETE /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 204 len: 0 microversion: 2.1 time: 0.195486 Aug 31 00:24:21.369239 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 208/406] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:24:21 2022] DELETE /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:24:21.371188 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-004e949e-f048-4089-b707-5c122e56e0ea tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:21.383438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-004e949e-f048-4089-b707-5c122e56e0ea tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1203 microversion: 2.1 time: 0.129404 Aug 31 00:24:21.384131 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 199/407] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:21 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1203 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:21.384656 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4106b411-f173-4704-9628-d33eb3430bf2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:21.385474 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4106b411-f173-4704-9628-d33eb3430bf2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:21.392885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4106b411-f173-4704-9628-d33eb3430bf2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.393412 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4106b411-f173-4704-9628-d33eb3430bf2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.393839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4106b411-f173-4704-9628-d33eb3430bf2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.394562 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4106b411-f173-4704-9628-d33eb3430bf2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.395012 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4106b411-f173-4704-9628-d33eb3430bf2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.395432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4106b411-f173-4704-9628-d33eb3430bf2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.457330 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-df7832a5-9d23-405a-83e7-a5d73039adb2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:21.458701 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-df7832a5-9d23-405a-83e7-a5d73039adb2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:21.465459 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df7832a5-9d23-405a-83e7-a5d73039adb2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.465958 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df7832a5-9d23-405a-83e7-a5d73039adb2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.466399 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df7832a5-9d23-405a-83e7-a5d73039adb2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.467123 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df7832a5-9d23-405a-83e7-a5d73039adb2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.467582 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df7832a5-9d23-405a-83e7-a5d73039adb2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.468048 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df7832a5-9d23-405a-83e7-a5d73039adb2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.734632 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4106b411-f173-4704-9628-d33eb3430bf2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:21.747210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4106b411-f173-4704-9628-d33eb3430bf2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1513 microversion: 2.1 time: 0.369391 Aug 31 00:24:21.748525 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 209/408] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:21 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:21.785955 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-df7832a5-9d23-405a-83e7-a5d73039adb2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:21.797425 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-df7832a5-9d23-405a-83e7-a5d73039adb2 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.345042 Aug 31 00:24:21.798904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 200/409] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:21 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:22.421917 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-49e54931-36b6-4ac2-ad74-65a837c20444 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:22.423217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-49e54931-36b6-4ac2-ad74-65a837c20444 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:22.430230 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-49e54931-36b6-4ac2-ad74-65a837c20444 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.430861 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-49e54931-36b6-4ac2-ad74-65a837c20444 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.431330 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-49e54931-36b6-4ac2-ad74-65a837c20444 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.432137 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-49e54931-36b6-4ac2-ad74-65a837c20444 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.432703 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-49e54931-36b6-4ac2-ad74-65a837c20444 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.433170 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-49e54931-36b6-4ac2-ad74-65a837c20444 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.600322 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-49e54931-36b6-4ac2-ad74-65a837c20444 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:22.608143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-49e54931-36b6-4ac2-ad74-65a837c20444 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1270 microversion: 2.1 time: 0.190870 Aug 31 00:24:22.608720 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 210/410] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:22 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:22.775357 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-75287d5a-f71e-4681-958b-eb475450125e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:22.775986 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-75287d5a-f71e-4681-958b-eb475450125e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:22.782989 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75287d5a-f71e-4681-958b-eb475450125e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.783481 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75287d5a-f71e-4681-958b-eb475450125e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.783977 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75287d5a-f71e-4681-958b-eb475450125e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.784662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75287d5a-f71e-4681-958b-eb475450125e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.785125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75287d5a-f71e-4681-958b-eb475450125e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.785553 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75287d5a-f71e-4681-958b-eb475450125e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.841922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1343010f-f2d1-472e-827b-e22f32d9e5cb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:22.842547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1343010f-f2d1-472e-827b-e22f32d9e5cb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:22.849371 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1343010f-f2d1-472e-827b-e22f32d9e5cb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.849862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1343010f-f2d1-472e-827b-e22f32d9e5cb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.850304 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1343010f-f2d1-472e-827b-e22f32d9e5cb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.851038 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1343010f-f2d1-472e-827b-e22f32d9e5cb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.851494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1343010f-f2d1-472e-827b-e22f32d9e5cb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.851923 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1343010f-f2d1-472e-827b-e22f32d9e5cb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.856775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:22.982445 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-75287d5a-f71e-4681-958b-eb475450125e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:22.993660 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-75287d5a-f71e-4681-958b-eb475450125e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1513 microversion: 2.1 time: 0.222372 Aug 31 00:24:22.994243 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 201/411] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:22 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:23.040079 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1343010f-f2d1-472e-827b-e22f32d9e5cb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:23.048841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1343010f-f2d1-472e-827b-e22f32d9e5cb tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.210795 Aug 31 00:24:23.049432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 211/412] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:22 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:23.632321 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-29de9715-82e3-4067-a08b-ba0cbbc9a109 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:23.633370 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-29de9715-82e3-4067-a08b-ba0cbbc9a109 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:23.642343 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29de9715-82e3-4067-a08b-ba0cbbc9a109 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:23.644459 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29de9715-82e3-4067-a08b-ba0cbbc9a109 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:23.645299 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29de9715-82e3-4067-a08b-ba0cbbc9a109 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:23.646418 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29de9715-82e3-4067-a08b-ba0cbbc9a109 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:23.647166 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29de9715-82e3-4067-a08b-ba0cbbc9a109 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:23.648098 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29de9715-82e3-4067-a08b-ba0cbbc9a109 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:23.945971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-29de9715-82e3-4067-a08b-ba0cbbc9a109 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:23.961642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-29de9715-82e3-4067-a08b-ba0cbbc9a109 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1270 microversion: 2.1 time: 0.335513 Aug 31 00:24:23.962719 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 202/413] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:23 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1270 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:24.029470 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-db0d3d49-c573-452d-bdee-51c22049c0b2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:24.030543 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-db0d3d49-c573-452d-bdee-51c22049c0b2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:24.045468 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db0d3d49-c573-452d-bdee-51c22049c0b2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.045943 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db0d3d49-c573-452d-bdee-51c22049c0b2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.046261 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db0d3d49-c573-452d-bdee-51c22049c0b2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.046977 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db0d3d49-c573-452d-bdee-51c22049c0b2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.047579 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db0d3d49-c573-452d-bdee-51c22049c0b2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.047999 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-db0d3d49-c573-452d-bdee-51c22049c0b2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.079351 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e7dd6ad7-b6ed-437d-8cb2-3fd248003483 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:24.081231 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e7dd6ad7-b6ed-437d-8cb2-3fd248003483 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:24.092958 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7dd6ad7-b6ed-437d-8cb2-3fd248003483 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.093978 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7dd6ad7-b6ed-437d-8cb2-3fd248003483 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.095271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7dd6ad7-b6ed-437d-8cb2-3fd248003483 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.097529 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7dd6ad7-b6ed-437d-8cb2-3fd248003483 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.097692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7dd6ad7-b6ed-437d-8cb2-3fd248003483 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.098506 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7dd6ad7-b6ed-437d-8cb2-3fd248003483 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.518117 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-db0d3d49-c573-452d-bdee-51c22049c0b2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:24.528321 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-db0d3d49-c573-452d-bdee-51c22049c0b2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1513 microversion: 2.1 time: 0.503153 Aug 31 00:24:24.529076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 212/414] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:24 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1513 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:24.541355 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e7dd6ad7-b6ed-437d-8cb2-3fd248003483 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:24.553035 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e7dd6ad7-b6ed-437d-8cb2-3fd248003483 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.481897 Aug 31 00:24:24.553954 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 203/415] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:24 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:24.732213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-c02b27eb-86aa-47cf-b203-a0cb27f8457f req-720d7b9b-fb3c-45f1-9c02-3aed0bccb302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95e1f70-6a63-40b2-a053-4b043f6b1ffa", "tag": "c156e592-123d-470f-843d-661d21c8d777"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:24.743897 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c02b27eb-86aa-47cf-b203-a0cb27f8457f req-720d7b9b-fb3c-45f1-9c02-3aed0bccb302 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.744422 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c02b27eb-86aa-47cf-b203-a0cb27f8457f req-720d7b9b-fb3c-45f1-9c02-3aed0bccb302 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.744862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c02b27eb-86aa-47cf-b203-a0cb27f8457f req-720d7b9b-fb3c-45f1-9c02-3aed0bccb302 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.758434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-c02b27eb-86aa-47cf-b203-a0cb27f8457f req-720d7b9b-fb3c-45f1-9c02-3aed0bccb302 service nova] Creating event network-changed:c156e592-123d-470f-843d-661d21c8d777 for instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa on hv-cinder-85221 Aug 31 00:24:24.764044 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-c02b27eb-86aa-47cf-b203-a0cb27f8457f req-720d7b9b-fb3c-45f1-9c02-3aed0bccb302 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035562 Aug 31 00:24:24.765426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 213/416] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:24:25.005852 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-31b136c3-f69b-425b-a59d-fe6f05eb6759 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:25.008005 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-31b136c3-f69b-425b-a59d-fe6f05eb6759 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:25.020448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31b136c3-f69b-425b-a59d-fe6f05eb6759 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:25.021303 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31b136c3-f69b-425b-a59d-fe6f05eb6759 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:25.022324 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31b136c3-f69b-425b-a59d-fe6f05eb6759 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:25.024345 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31b136c3-f69b-425b-a59d-fe6f05eb6759 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:25.025171 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31b136c3-f69b-425b-a59d-fe6f05eb6759 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:25.025952 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31b136c3-f69b-425b-a59d-fe6f05eb6759 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:25.301213 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-31b136c3-f69b-425b-a59d-fe6f05eb6759 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:25.309528 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-31b136c3-f69b-425b-a59d-fe6f05eb6759 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.328625 Aug 31 00:24:25.310518 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 204/417] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:24 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:25.561558 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:25.562270 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:25.570993 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:25.571486 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:25.572078 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:25.572744 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:25.573164 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:25.573603 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:25.581804 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-fdd07fb6-788c-4b29-894d-e276c889908c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:25.582944 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-fdd07fb6-788c-4b29-894d-e276c889908c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:25.595219 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fdd07fb6-788c-4b29-894d-e276c889908c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:25.596133 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fdd07fb6-788c-4b29-894d-e276c889908c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:25.596959 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fdd07fb6-788c-4b29-894d-e276c889908c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:25.598305 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fdd07fb6-788c-4b29-894d-e276c889908c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:25.599180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fdd07fb6-788c-4b29-894d-e276c889908c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:25.599987 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fdd07fb6-788c-4b29-894d-e276c889908c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:25.612918 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:25.613410 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:25.613845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:25.614354 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lazy-loading 'fault' on Instance uuid 166c7ed8-54c6-4829-8e41-217e47eaecb7 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:25.673596 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:25.682827 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a2df2d85-c635-4d30-bac6-fa5b592e8ae7 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1309 microversion: 2.1 time: 0.126292 Aug 31 00:24:25.683709 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 214/418] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:25 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:25.787828 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-fdd07fb6-788c-4b29-894d-e276c889908c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:25.803751 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-fdd07fb6-788c-4b29-894d-e276c889908c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.230787 Aug 31 00:24:25.804862 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 205/419] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:25 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:26.332896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-fb9dab24-568f-48b6-b5c7-50830f91d163 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:26.333502 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-fb9dab24-568f-48b6-b5c7-50830f91d163 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:26.340369 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb9dab24-568f-48b6-b5c7-50830f91d163 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:26.341149 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb9dab24-568f-48b6-b5c7-50830f91d163 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:26.341794 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb9dab24-568f-48b6-b5c7-50830f91d163 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:26.342580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb9dab24-568f-48b6-b5c7-50830f91d163 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:26.343179 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb9dab24-568f-48b6-b5c7-50830f91d163 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:26.343644 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb9dab24-568f-48b6-b5c7-50830f91d163 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:26.525336 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-fb9dab24-568f-48b6-b5c7-50830f91d163 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:26.540021 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-fb9dab24-568f-48b6-b5c7-50830f91d163 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.211488 Aug 31 00:24:26.540768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 215/420] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:26 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:26.712088 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:26.713203 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:26.726115 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:26.726971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:26.727747 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:26.729292 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:26.730125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:26.730894 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:26.796862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-b06c2f8a-1ef2-4497-9e47-ea2f046e37c6 req-ae834269-791d-4f4a-94b9-68198eee5002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166c7ed8-54c6-4829-8e41-217e47eaecb7", "name": "network-vif-deleted", "tag": "bf93a34c-ae93-4182-80ce-4c70d2e698de"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:26.813140 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:26.815926 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-b06c2f8a-1ef2-4497-9e47-ea2f046e37c6 req-ae834269-791d-4f4a-94b9-68198eee5002 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:26.816834 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-b06c2f8a-1ef2-4497-9e47-ea2f046e37c6 req-ae834269-791d-4f4a-94b9-68198eee5002 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:26.817961 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-b06c2f8a-1ef2-4497-9e47-ea2f046e37c6 req-ae834269-791d-4f4a-94b9-68198eee5002 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:26.818189 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:26.818658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:26.819245 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lazy-loading 'fault' on Instance uuid 166c7ed8-54c6-4829-8e41-217e47eaecb7 {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:26.840112 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-b06c2f8a-1ef2-4497-9e47-ea2f046e37c6 req-ae834269-791d-4f4a-94b9-68198eee5002 service nova] Creating event network-vif-deleted:bf93a34c-ae93-4182-80ce-4c70d2e698de for instance 166c7ed8-54c6-4829-8e41-217e47eaecb7 on hv-cinder-85221 Aug 31 00:24:26.851662 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-b06c2f8a-1ef2-4497-9e47-ea2f046e37c6 req-ae834269-791d-4f4a-94b9-68198eee5002 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061389 Aug 31 00:24:26.853449 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 216/421] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:26.863714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c100c965-4335-4030-bdd0-785888c94f1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:26.865521 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c100c965-4335-4030-bdd0-785888c94f1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:26.876017 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c100c965-4335-4030-bdd0-785888c94f1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:26.880719 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:26.885287 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c100c965-4335-4030-bdd0-785888c94f1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:26.887074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c100c965-4335-4030-bdd0-785888c94f1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:26.889001 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c100c965-4335-4030-bdd0-785888c94f1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:26.891023 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c100c965-4335-4030-bdd0-785888c94f1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:26.892539 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c100c965-4335-4030-bdd0-785888c94f1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:26.893129 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ab721325-0c28-42e6-9d45-cb16da0175ee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 200 len: 1309 microversion: 2.1 time: 0.189220 Aug 31 00:24:26.894137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 206/422] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:26 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:27.304569 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c100c965-4335-4030-bdd0-785888c94f1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:27.312915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c100c965-4335-4030-bdd0-785888c94f1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.457991 Aug 31 00:24:27.315051 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 217/423] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:26 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:27.563912 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9e9f0356-8af4-4fa6-be8c-df4129224618 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:27.564557 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9e9f0356-8af4-4fa6-be8c-df4129224618 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:27.571462 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e9f0356-8af4-4fa6-be8c-df4129224618 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.571957 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e9f0356-8af4-4fa6-be8c-df4129224618 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.572433 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e9f0356-8af4-4fa6-be8c-df4129224618 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.573412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e9f0356-8af4-4fa6-be8c-df4129224618 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.573990 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e9f0356-8af4-4fa6-be8c-df4129224618 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.574486 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9e9f0356-8af4-4fa6-be8c-df4129224618 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.722780 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9e9f0356-8af4-4fa6-be8c-df4129224618 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:27.733128 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9e9f0356-8af4-4fa6-be8c-df4129224618 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.172903 Aug 31 00:24:27.734032 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 207/424] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:27 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:27.925530 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:27.926219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: 166c7ed8-54c6-4829-8e41-217e47eaecb7] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:27.933380 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.933857 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.934285 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.935000 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.935472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.935892 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.953967 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] HTTP exception thrown: Instance 166c7ed8-54c6-4829-8e41-217e47eaecb7 could not be found. Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Request method failure captured: Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 HTTP/1.1 Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqnagIRLGtW4o5XwrhbQUCv8oOZGUW_nUE1X7zbxklJRH1xQ1W8EN_TlSO8EgdwtQxGn7C-s8WEbzHB4amLaYnQpFKCZDkyGD7BwBNX3WQIQLInlgzY35A1E27y-B9uFSwxYzG4l5_lawLobBjts30H6tEVti71tpzURHU7_X5fhN1w Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 29f449e37cc6482eaca34671c7541c4b Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-VolumesSnapshotTestJSON-928626591 Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:24:27.956003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/29f449e37cc6482eaca34671c7541c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/29f449e37cc6482eaca34671c7541c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/29f449e37cc6482eaca34671c7541c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_29f449e37cc6482eaca34671c7541c4b"}]}] Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-VolumesSnapshotTestJSON-928626591 Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 29f449e37cc6482eaca34671c7541c4b Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-928626591 Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-VolumesSnapshotTestJSON-928626591-project Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: c9dd5782e5f84ed68282cdda78ce909f Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-VolumesSnapshotTestJSON-928626591-project Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 166c7ed8-54c6-4829-8e41-217e47eaecb7 could not be found. Aug 31 00:24:27.958767 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '166c7ed8-54c6-4829-8e41-217e47eaecb7'} Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 166c7ed8-54c6-4829-8e41-217e47eaecb7 could not be found. Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:24:27.960130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 166c7ed8-54c6-4829-8e41-217e47eaecb7 could not be found. Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 166c7ed8-54c6-4829-8e41-217e47eaecb7 could not be found. Aug 31 00:24:27.962478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:27.965289 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Returning 404 to user: Instance 166c7ed8-54c6-4829-8e41-217e47eaecb7 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:24:27.965289 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8a09695f-2af4-450f-a03d-562dafc69800 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7" status: 404 len: 111 microversion: 2.1 time: 0.038225 Aug 31 00:24:27.965289 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 218/425] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:27 2022] GET /compute/v2.1/servers/166c7ed8-54c6-4829-8e41-217e47eaecb7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:28.335552 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-010e769a-7a5e-454d-b71b-5253c9f72857 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:28.336180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-010e769a-7a5e-454d-b71b-5253c9f72857 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:28.342868 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-010e769a-7a5e-454d-b71b-5253c9f72857 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:28.343355 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-010e769a-7a5e-454d-b71b-5253c9f72857 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:28.343785 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-010e769a-7a5e-454d-b71b-5253c9f72857 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:28.344565 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-010e769a-7a5e-454d-b71b-5253c9f72857 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:28.345006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-010e769a-7a5e-454d-b71b-5253c9f72857 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:28.345427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-010e769a-7a5e-454d-b71b-5253c9f72857 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:28.513093 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-010e769a-7a5e-454d-b71b-5253c9f72857 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:28.522011 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-010e769a-7a5e-454d-b71b-5253c9f72857 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.190372 Aug 31 00:24:28.522610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 208/426] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:28 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:28.755811 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-845bbd6c-09db-4274-89ea-70d91237ece8 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:28.756475 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-845bbd6c-09db-4274-89ea-70d91237ece8 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:28.763768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-845bbd6c-09db-4274-89ea-70d91237ece8 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:28.764220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-845bbd6c-09db-4274-89ea-70d91237ece8 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:28.764686 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-845bbd6c-09db-4274-89ea-70d91237ece8 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:28.765393 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-845bbd6c-09db-4274-89ea-70d91237ece8 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:28.765841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-845bbd6c-09db-4274-89ea-70d91237ece8 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:28.767156 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-845bbd6c-09db-4274-89ea-70d91237ece8 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:28.914568 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-845bbd6c-09db-4274-89ea-70d91237ece8 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:28.923127 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-845bbd6c-09db-4274-89ea-70d91237ece8 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.170775 Aug 31 00:24:28.923731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 219/427] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:28 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:29.544682 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-41df7c6a-e956-4003-b0bf-94897d195183 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:29.545358 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-41df7c6a-e956-4003-b0bf-94897d195183 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:29.547289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:29.548350 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=6 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:29.556369 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-41df7c6a-e956-4003-b0bf-94897d195183 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:29.556825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-41df7c6a-e956-4003-b0bf-94897d195183 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:29.557370 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-41df7c6a-e956-4003-b0bf-94897d195183 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:29.558074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-41df7c6a-e956-4003-b0bf-94897d195183 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:29.558530 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-41df7c6a-e956-4003-b0bf-94897d195183 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:29.558954 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-41df7c6a-e956-4003-b0bf-94897d195183 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:29.705364 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-41df7c6a-e956-4003-b0bf-94897d195183 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:29.714041 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-41df7c6a-e956-4003-b0bf-94897d195183 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.173797 Aug 31 00:24:29.714794 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 209/428] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:29 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:29.945146 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ee0ad804-6821-4d80-bc6d-1d6386bc0103 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:29.946088 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ee0ad804-6821-4d80-bc6d-1d6386bc0103 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:29.949116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:29.955578 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee0ad804-6821-4d80-bc6d-1d6386bc0103 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:29.956098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee0ad804-6821-4d80-bc6d-1d6386bc0103 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:29.956588 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee0ad804-6821-4d80-bc6d-1d6386bc0103 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:29.957295 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee0ad804-6821-4d80-bc6d-1d6386bc0103 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:29.957744 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee0ad804-6821-4d80-bc6d-1d6386bc0103 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:29.958169 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee0ad804-6821-4d80-bc6d-1d6386bc0103 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:30.122330 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ee0ad804-6821-4d80-bc6d-1d6386bc0103 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:30.134055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ee0ad804-6821-4d80-bc6d-1d6386bc0103 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.192770 Aug 31 00:24:30.135111 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 220/429] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:29 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:30.738903 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d836ecb3-af00-49d3-8561-d387b1fa431e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:30.739561 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d836ecb3-af00-49d3-8561-d387b1fa431e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:30.746783 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d836ecb3-af00-49d3-8561-d387b1fa431e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:30.747286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d836ecb3-af00-49d3-8561-d387b1fa431e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:30.747726 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d836ecb3-af00-49d3-8561-d387b1fa431e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:30.748512 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d836ecb3-af00-49d3-8561-d387b1fa431e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:30.748968 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d836ecb3-af00-49d3-8561-d387b1fa431e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:30.749397 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d836ecb3-af00-49d3-8561-d387b1fa431e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:30.770207 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=100 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:30.897847 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d836ecb3-af00-49d3-8561-d387b1fa431e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:30.907990 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d836ecb3-af00-49d3-8561-d387b1fa431e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1675 microversion: 2.1 time: 0.172361 Aug 31 00:24:30.908826 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 210/430] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:30 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:31.171124 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8c7a3306-344e-4167-92f9-11895b38a47a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:31.171760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8c7a3306-344e-4167-92f9-11895b38a47a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:31.179491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c7a3306-344e-4167-92f9-11895b38a47a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.179981 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c7a3306-344e-4167-92f9-11895b38a47a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.180453 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c7a3306-344e-4167-92f9-11895b38a47a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:31.181174 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c7a3306-344e-4167-92f9-11895b38a47a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.181628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c7a3306-344e-4167-92f9-11895b38a47a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.182048 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c7a3306-344e-4167-92f9-11895b38a47a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:31.378711 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8c7a3306-344e-4167-92f9-11895b38a47a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:31.387500 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8c7a3306-344e-4167-92f9-11895b38a47a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.220256 Aug 31 00:24:31.388104 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 221/431] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:31 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:31.930389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b2578789-8aed-47d3-8534-1bb970c8ab45 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:31.931071 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b2578789-8aed-47d3-8534-1bb970c8ab45 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:31.938127 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2578789-8aed-47d3-8534-1bb970c8ab45 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.938914 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2578789-8aed-47d3-8534-1bb970c8ab45 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.939453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2578789-8aed-47d3-8534-1bb970c8ab45 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:31.940343 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2578789-8aed-47d3-8534-1bb970c8ab45 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.940700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2578789-8aed-47d3-8534-1bb970c8ab45 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.941135 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2578789-8aed-47d3-8534-1bb970c8ab45 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:32.091419 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b2578789-8aed-47d3-8534-1bb970c8ab45 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:32.105150 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b2578789-8aed-47d3-8534-1bb970c8ab45 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1652 microversion: 2.1 time: 0.178535 Aug 31 00:24:32.106274 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 211/432] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:31 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1652 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:32.129315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3a91c0fe-495d-4cf1-a428-93e5f44e6228 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:32.132105 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:32.147526 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3a91c0fe-495d-4cf1-a428-93e5f44e6228 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:32.148033 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3a91c0fe-495d-4cf1-a428-93e5f44e6228 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:32.148520 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3a91c0fe-495d-4cf1-a428-93e5f44e6228 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:32.180099 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3a91c0fe-495d-4cf1-a428-93e5f44e6228 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Going to try to start instance {{(pid=127118) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 00:24:32.230495 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3a91c0fe-495d-4cf1-a428-93e5f44e6228 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "POST /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/action" status: 202 len: 0 microversion: 2.1 time: 0.105318 Aug 31 00:24:32.231058 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 222/433] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:24:32 2022] POST /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:24:32.239533 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-632a7784-7edc-4a67-8751-f9d2178c75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:32.240167 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-632a7784-7edc-4a67-8751-f9d2178c75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:32.246841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-632a7784-7edc-4a67-8751-f9d2178c75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:32.247333 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-632a7784-7edc-4a67-8751-f9d2178c75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:32.247770 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-632a7784-7edc-4a67-8751-f9d2178c75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:32.248573 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-632a7784-7edc-4a67-8751-f9d2178c75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:32.249028 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-632a7784-7edc-4a67-8751-f9d2178c75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:32.249451 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-632a7784-7edc-4a67-8751-f9d2178c75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:32.417249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-273b260a-cf83-4f97-83ad-a4237897a9c1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:32.418461 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-273b260a-cf83-4f97-83ad-a4237897a9c1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:32.431028 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-273b260a-cf83-4f97-83ad-a4237897a9c1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:32.431824 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-273b260a-cf83-4f97-83ad-a4237897a9c1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:32.432563 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-273b260a-cf83-4f97-83ad-a4237897a9c1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:32.433932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-273b260a-cf83-4f97-83ad-a4237897a9c1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:32.434653 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-273b260a-cf83-4f97-83ad-a4237897a9c1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:32.435247 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-273b260a-cf83-4f97-83ad-a4237897a9c1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:32.438866 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-632a7784-7edc-4a67-8751-f9d2178c75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:32.452914 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-632a7784-7edc-4a67-8751-f9d2178c75a1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1661 microversion: 2.1 time: 0.216859 Aug 31 00:24:32.455165 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 212/434] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:32 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1661 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:32.674577 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-273b260a-cf83-4f97-83ad-a4237897a9c1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:32.690416 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-273b260a-cf83-4f97-83ad-a4237897a9c1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.280091 Aug 31 00:24:32.691372 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 223/435] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:32 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:33.489352 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-92f8bef1-ceba-4519-817b-ed6d882511dc tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:33.489971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-92f8bef1-ceba-4519-817b-ed6d882511dc tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:33.497162 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92f8bef1-ceba-4519-817b-ed6d882511dc tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:33.497662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92f8bef1-ceba-4519-817b-ed6d882511dc tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:33.498094 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92f8bef1-ceba-4519-817b-ed6d882511dc tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:33.498801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92f8bef1-ceba-4519-817b-ed6d882511dc tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:33.499328 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92f8bef1-ceba-4519-817b-ed6d882511dc tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:33.499675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92f8bef1-ceba-4519-817b-ed6d882511dc tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:33.662354 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-92f8bef1-ceba-4519-817b-ed6d882511dc tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:33.671339 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-92f8bef1-ceba-4519-817b-ed6d882511dc tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1661 microversion: 2.1 time: 0.186556 Aug 31 00:24:33.672142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 213/436] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:33 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1661 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:33.716997 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3e047b16-b730-49eb-b4c0-ab43c74c4a8b tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:33.717720 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3e047b16-b730-49eb-b4c0-ab43c74c4a8b tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:33.725370 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e047b16-b730-49eb-b4c0-ab43c74c4a8b tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:33.725900 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e047b16-b730-49eb-b4c0-ab43c74c4a8b tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:33.726338 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e047b16-b730-49eb-b4c0-ab43c74c4a8b tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:33.727064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e047b16-b730-49eb-b4c0-ab43c74c4a8b tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:33.727523 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e047b16-b730-49eb-b4c0-ab43c74c4a8b tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:33.727947 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e047b16-b730-49eb-b4c0-ab43c74c4a8b tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:33.943467 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3e047b16-b730-49eb-b4c0-ab43c74c4a8b tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:33.953884 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3e047b16-b730-49eb-b4c0-ab43c74c4a8b tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.241516 Aug 31 00:24:33.954878 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 224/437] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:33 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:34.477541 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f484e8c1-b671-4cba-9f24-f6f33b6b8734 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc8320c0-5911-4a69-a1bc-f73992b64e41"}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:34.480141 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f484e8c1-b671-4cba-9f24-f6f33b6b8734 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:34.487873 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f484e8c1-b671-4cba-9f24-f6f33b6b8734 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.488267 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f484e8c1-b671-4cba-9f24-f6f33b6b8734 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.488710 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f484e8c1-b671-4cba-9f24-f6f33b6b8734 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:34.489439 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f484e8c1-b671-4cba-9f24-f6f33b6b8734 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.490003 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f484e8c1-b671-4cba-9f24-f6f33b6b8734 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.490311 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f484e8c1-b671-4cba-9f24-f6f33b6b8734 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:34.694517 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ec2c9dc1-cc5f-4d9d-9e70-da69a24b14a6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:34.695182 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ec2c9dc1-cc5f-4d9d-9e70-da69a24b14a6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:34.701933 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ec2c9dc1-cc5f-4d9d-9e70-da69a24b14a6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.702428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ec2c9dc1-cc5f-4d9d-9e70-da69a24b14a6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.702882 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ec2c9dc1-cc5f-4d9d-9e70-da69a24b14a6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:34.704211 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ec2c9dc1-cc5f-4d9d-9e70-da69a24b14a6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.705164 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ec2c9dc1-cc5f-4d9d-9e70-da69a24b14a6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.705164 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ec2c9dc1-cc5f-4d9d-9e70-da69a24b14a6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:34.862513 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ec2c9dc1-cc5f-4d9d-9e70-da69a24b14a6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:34.872033 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ec2c9dc1-cc5f-4d9d-9e70-da69a24b14a6 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1665 microversion: 2.1 time: 0.181451 Aug 31 00:24:34.872675 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 225/438] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:34 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1665 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:34.988824 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4a7a6ef6-6660-4942-b291-45a7019c46ce tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:34.989467 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4a7a6ef6-6660-4942-b291-45a7019c46ce tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:34.997789 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a7a6ef6-6660-4942-b291-45a7019c46ce tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.998821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a7a6ef6-6660-4942-b291-45a7019c46ce tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.999473 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a7a6ef6-6660-4942-b291-45a7019c46ce tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:35.000994 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a7a6ef6-6660-4942-b291-45a7019c46ce tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:35.001835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a7a6ef6-6660-4942-b291-45a7019c46ce tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:35.002228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4a7a6ef6-6660-4942-b291-45a7019c46ce tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:35.227537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4a7a6ef6-6660-4942-b291-45a7019c46ce tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:35.238321 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4a7a6ef6-6660-4942-b291-45a7019c46ce tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.253602 Aug 31 00:24:35.238986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 226/439] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:34 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:36.261045 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-dd79d86f-21b5-473d-bcaa-9d41c6a8d105 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:36.261772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-dd79d86f-21b5-473d-bcaa-9d41c6a8d105 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:36.270346 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd79d86f-21b5-473d-bcaa-9d41c6a8d105 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:36.270837 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd79d86f-21b5-473d-bcaa-9d41c6a8d105 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:36.271272 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd79d86f-21b5-473d-bcaa-9d41c6a8d105 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:36.271994 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd79d86f-21b5-473d-bcaa-9d41c6a8d105 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:36.272484 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd79d86f-21b5-473d-bcaa-9d41c6a8d105 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:36.272912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd79d86f-21b5-473d-bcaa-9d41c6a8d105 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:36.430306 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-dd79d86f-21b5-473d-bcaa-9d41c6a8d105 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:36.439215 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-dd79d86f-21b5-473d-bcaa-9d41c6a8d105 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.182362 Aug 31 00:24:36.439827 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 227/440] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:36 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:37.461622 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-00569283-a214-4c87-be0e-42b4859fe797 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:37.462712 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-00569283-a214-4c87-be0e-42b4859fe797 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:37.471765 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00569283-a214-4c87-be0e-42b4859fe797 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:37.472932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00569283-a214-4c87-be0e-42b4859fe797 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:37.473398 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00569283-a214-4c87-be0e-42b4859fe797 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:37.474168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00569283-a214-4c87-be0e-42b4859fe797 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:37.474641 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00569283-a214-4c87-be0e-42b4859fe797 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:37.475121 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-00569283-a214-4c87-be0e-42b4859fe797 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:37.501629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:37.681885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-00569283-a214-4c87-be0e-42b4859fe797 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:37.701157 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-00569283-a214-4c87-be0e-42b4859fe797 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.239695 Aug 31 00:24:37.702389 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 228/441] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:37 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:37.734611 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f484e8c1-b671-4cba-9f24-f6f33b6b8734 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "POST /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.260443 Aug 31 00:24:37.736591 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 214/442] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:24:34 2022] POST /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments => generated 194 bytes in 3264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:38.019493 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-5d957bb3-a0bf-4ca4-aa63-97a45131f47c req-4214e92a-c3b4-4c66-b69f-099db7cfc3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95e1f70-6a63-40b2-a053-4b043f6b1ffa", "name": "network-vif-plugged", "status": "completed", "tag": "c156e592-123d-470f-843d-661d21c8d777"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:38.030369 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-5d957bb3-a0bf-4ca4-aa63-97a45131f47c req-4214e92a-c3b4-4c66-b69f-099db7cfc3cc service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:38.030864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-5d957bb3-a0bf-4ca4-aa63-97a45131f47c req-4214e92a-c3b4-4c66-b69f-099db7cfc3cc service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:38.031306 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-5d957bb3-a0bf-4ca4-aa63-97a45131f47c req-4214e92a-c3b4-4c66-b69f-099db7cfc3cc service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:38.051738 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-5d957bb3-a0bf-4ca4-aa63-97a45131f47c req-4214e92a-c3b4-4c66-b69f-099db7cfc3cc service nova] Creating event network-vif-plugged:c156e592-123d-470f-843d-661d21c8d777 for instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa on hv-cinder-85221 Aug 31 00:24:38.063196 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-5d957bb3-a0bf-4ca4-aa63-97a45131f47c req-4214e92a-c3b4-4c66-b69f-099db7cfc3cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047035 Aug 31 00:24:38.064368 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 229/443] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:38.376231 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-41015013", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "networks": [{"uuid": "fc7bd654-7a6a-455d-b9c1-26e1fa3e9adb"}]}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:38.456910 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] validate_networks() for [('fc7bd654-7a6a-455d-b9c1-26e1fa3e9adb', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:24:38.729858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-67ab47c3-6dc0-4ad1-b18d-a7b553ff5c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:38.731326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-67ab47c3-6dc0-4ad1-b18d-a7b553ff5c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:38.740472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67ab47c3-6dc0-4ad1-b18d-a7b553ff5c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:38.741141 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67ab47c3-6dc0-4ad1-b18d-a7b553ff5c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:38.741580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67ab47c3-6dc0-4ad1-b18d-a7b553ff5c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:38.742412 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67ab47c3-6dc0-4ad1-b18d-a7b553ff5c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:38.743054 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67ab47c3-6dc0-4ad1-b18d-a7b553ff5c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:38.743652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67ab47c3-6dc0-4ad1-b18d-a7b553ff5c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:39.035947 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-67ab47c3-6dc0-4ad1-b18d-a7b553ff5c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:39.046329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-67ab47c3-6dc0-4ad1-b18d-a7b553ff5c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.321370 Aug 31 00:24:39.047694 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 230/444] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:38 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:39.099262 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:24:39.099837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:24:39.100330 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:24:39.100820 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:24:39.101342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:24:39.111802 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:39.112342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:39.112781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:39.113559 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:39.114011 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:39.114437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:39.134247 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Getting quotas for project 29f449e37cc6482eaca34671c7541c4b. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:24:39.138966 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Getting quotas for user c9dd5782e5f84ed68282cdda78ce909f and project 29f449e37cc6482eaca34671c7541c4b. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:24:39.152894 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:24:39.155363 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:24:39.223331 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8011f276-b464-427f-844d-b41683ab1cf4 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851417 Aug 31 00:24:39.224849 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 215/445] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:24:39.243603 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-801be74b-4124-4ae5-afdc-2193165a15fe tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:39.244983 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-801be74b-4124-4ae5-afdc-2193165a15fe tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:39.335668 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-801be74b-4124-4ae5-afdc-2193165a15fe tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:39.348706 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-801be74b-4124-4ae5-afdc-2193165a15fe tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1217 microversion: 2.1 time: 0.112458 Aug 31 00:24:39.349519 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 231/446] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:39 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:40.081436 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7ada13bc-f63a-4de2-9680-7005944ac0cd tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:40.082241 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7ada13bc-f63a-4de2-9680-7005944ac0cd tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:40.090249 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7ada13bc-f63a-4de2-9680-7005944ac0cd tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:40.090757 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7ada13bc-f63a-4de2-9680-7005944ac0cd tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:40.091205 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7ada13bc-f63a-4de2-9680-7005944ac0cd tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:40.091937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7ada13bc-f63a-4de2-9680-7005944ac0cd tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:40.092861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7ada13bc-f63a-4de2-9680-7005944ac0cd tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:40.093329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7ada13bc-f63a-4de2-9680-7005944ac0cd tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:40.262008 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7ada13bc-f63a-4de2-9680-7005944ac0cd tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:40.271281 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7ada13bc-f63a-4de2-9680-7005944ac0cd tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1258 microversion: 2.1 time: 0.194479 Aug 31 00:24:40.272026 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 216/447] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:40 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1258 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:40.371979 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e54dbdcf-8669-429a-bfad-ba1c89c81039 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:40.372657 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e54dbdcf-8669-429a-bfad-ba1c89c81039 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:40.380203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e54dbdcf-8669-429a-bfad-ba1c89c81039 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:40.380699 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e54dbdcf-8669-429a-bfad-ba1c89c81039 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:40.381137 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e54dbdcf-8669-429a-bfad-ba1c89c81039 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:40.381887 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e54dbdcf-8669-429a-bfad-ba1c89c81039 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:40.382377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e54dbdcf-8669-429a-bfad-ba1c89c81039 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:40.382774 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e54dbdcf-8669-429a-bfad-ba1c89c81039 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:40.455516 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e54dbdcf-8669-429a-bfad-ba1c89c81039 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:40.463852 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e54dbdcf-8669-429a-bfad-ba1c89c81039 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1221 microversion: 2.1 time: 0.096527 Aug 31 00:24:40.464494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 232/448] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:40 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:41.295544 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1ae8818e-fdfc-4aff-81d2-875f10acc794 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:41.296862 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1ae8818e-fdfc-4aff-81d2-875f10acc794 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:41.305747 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:41.313716 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1ae8818e-fdfc-4aff-81d2-875f10acc794 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:41.314204 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1ae8818e-fdfc-4aff-81d2-875f10acc794 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:41.314840 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1ae8818e-fdfc-4aff-81d2-875f10acc794 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:41.315569 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1ae8818e-fdfc-4aff-81d2-875f10acc794 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:41.316249 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1ae8818e-fdfc-4aff-81d2-875f10acc794 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:41.316684 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1ae8818e-fdfc-4aff-81d2-875f10acc794 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:41.491936 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4c68ae4a-f8c9-46ec-84c8-464cb63bab25 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:41.493184 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4c68ae4a-f8c9-46ec-84c8-464cb63bab25 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:41.508826 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c68ae4a-f8c9-46ec-84c8-464cb63bab25 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:41.509785 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c68ae4a-f8c9-46ec-84c8-464cb63bab25 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:41.510572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c68ae4a-f8c9-46ec-84c8-464cb63bab25 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:41.511823 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c68ae4a-f8c9-46ec-84c8-464cb63bab25 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:41.512828 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c68ae4a-f8c9-46ec-84c8-464cb63bab25 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:41.513607 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c68ae4a-f8c9-46ec-84c8-464cb63bab25 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:41.538292 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1ae8818e-fdfc-4aff-81d2-875f10acc794 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:41.554727 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1ae8818e-fdfc-4aff-81d2-875f10acc794 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1442 microversion: 2.1 time: 0.264313 Aug 31 00:24:41.555741 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 217/449] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:41 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1442 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:41.590634 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f5b9b06c-f3d6-48df-bdfb-ccd9badbed59 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:41.591637 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f5b9b06c-f3d6-48df-bdfb-ccd9badbed59 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:41.599295 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f5b9b06c-f3d6-48df-bdfb-ccd9badbed59 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:41.599906 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f5b9b06c-f3d6-48df-bdfb-ccd9badbed59 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:41.600687 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f5b9b06c-f3d6-48df-bdfb-ccd9badbed59 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:41.601742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f5b9b06c-f3d6-48df-bdfb-ccd9badbed59 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:41.602206 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f5b9b06c-f3d6-48df-bdfb-ccd9badbed59 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:41.602662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f5b9b06c-f3d6-48df-bdfb-ccd9badbed59 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:41.606854 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4c68ae4a-f8c9-46ec-84c8-464cb63bab25 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:41.616906 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4c68ae4a-f8c9-46ec-84c8-464cb63bab25 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1269 microversion: 2.1 time: 0.134615 Aug 31 00:24:41.617765 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 233/450] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:41 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:41.803402 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f5b9b06c-f3d6-48df-bdfb-ccd9badbed59 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:41.815618 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f5b9b06c-f3d6-48df-bdfb-ccd9badbed59 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1442 microversion: 2.1 time: 0.229120 Aug 31 00:24:41.816312 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 218/451] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:41 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1442 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:42.265133 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-15eb68d5-647f-45e9-969e-fef948f62d90 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:42.269299 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-15eb68d5-647f-45e9-969e-fef948f62d90 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:42.283210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-15eb68d5-647f-45e9-969e-fef948f62d90 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:42.284030 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-15eb68d5-647f-45e9-969e-fef948f62d90 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:42.284809 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-15eb68d5-647f-45e9-969e-fef948f62d90 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:42.286071 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-15eb68d5-647f-45e9-969e-fef948f62d90 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:42.286900 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-15eb68d5-647f-45e9-969e-fef948f62d90 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:42.287670 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-15eb68d5-647f-45e9-969e-fef948f62d90 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:42.334639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-15eb68d5-647f-45e9-969e-fef948f62d90 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lazy-loading 'flavor' on Instance uuid 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:42.522703 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-15eb68d5-647f-45e9-969e-fef948f62d90 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "POST /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/action" status: 200 len: 32 microversion: 2.1 time: 0.265425 Aug 31 00:24:42.524004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 234/452] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:24:42 2022] POST /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/action => generated 32 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:24:42.535351 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f6df49de-7a17-4728-9cf2-9922d7cbc539 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:42.536007 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f6df49de-7a17-4728-9cf2-9922d7cbc539 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:42.543568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6df49de-7a17-4728-9cf2-9922d7cbc539 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:42.544081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6df49de-7a17-4728-9cf2-9922d7cbc539 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:42.544583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6df49de-7a17-4728-9cf2-9922d7cbc539 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:42.545357 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6df49de-7a17-4728-9cf2-9922d7cbc539 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:42.545832 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6df49de-7a17-4728-9cf2-9922d7cbc539 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:42.546291 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6df49de-7a17-4728-9cf2-9922d7cbc539 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:42.646950 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c1a25dbb-bff8-449c-9c2e-8c777bf3ae82 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:42.647695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c1a25dbb-bff8-449c-9c2e-8c777bf3ae82 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:42.655243 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c1a25dbb-bff8-449c-9c2e-8c777bf3ae82 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:42.655738 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c1a25dbb-bff8-449c-9c2e-8c777bf3ae82 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:42.656216 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c1a25dbb-bff8-449c-9c2e-8c777bf3ae82 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:42.657280 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c1a25dbb-bff8-449c-9c2e-8c777bf3ae82 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:42.657752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c1a25dbb-bff8-449c-9c2e-8c777bf3ae82 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:42.658180 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c1a25dbb-bff8-449c-9c2e-8c777bf3ae82 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:42.898310 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c1a25dbb-bff8-449c-9c2e-8c777bf3ae82 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:42.907526 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c1a25dbb-bff8-449c-9c2e-8c777bf3ae82 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1275 microversion: 2.1 time: 0.266156 Aug 31 00:24:42.908181 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 235/453] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:42 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1275 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:43.127424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-eb234fc2-03bf-446a-b21e-141c9d52e9be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:43.127940 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-eb234fc2-03bf-446a-b21e-141c9d52e9be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:43.135632 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eb234fc2-03bf-446a-b21e-141c9d52e9be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:43.136305 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eb234fc2-03bf-446a-b21e-141c9d52e9be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:43.136743 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eb234fc2-03bf-446a-b21e-141c9d52e9be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:43.137555 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eb234fc2-03bf-446a-b21e-141c9d52e9be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:43.138073 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eb234fc2-03bf-446a-b21e-141c9d52e9be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:43.138502 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eb234fc2-03bf-446a-b21e-141c9d52e9be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:43.168444 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-eb234fc2-03bf-446a-b21e-141c9d52e9be tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5/ips" status: 200 len: 149 microversion: 2.1 time: 0.044837 Aug 31 00:24:43.168882 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 236/454] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 31 00:24:43 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:24:43.181394 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:43.184440 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:43.194194 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:43.195675 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:43.196146 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:43.196946 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:43.197411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:43.197896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:43.299294 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Invalid volume: volume 0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3 is already attached to instances: 1d377dbb-6731-491e-bc79-3c63e6eb99a0 Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: POST /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5/os-volume_attachments HTTP/1.1 Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 74 Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:24:43.301059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {"volumeAttachment": {"volumeId": "0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3"}} Aug 31 00:24:43.303314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Invalid volume: volume 0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3 is already attached to instances: 1d377dbb-6731-491e-bc79-3c63e6eb99a0 Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'server_id': '8fdf4278-aa30-4d1a-8c4d-94afd592aba5', 'body': {'volumeAttachment': {'volumeId': '0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3'}}} Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3 is already attached to instances: 1d377dbb-6731-491e-bc79-3c63e6eb99a0 Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:43.304763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3 is already attached to instances: 1d377dbb-6731-491e-bc79-3c63e6eb99a0 Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:43.307195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:43.311472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:43.311472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:24:43.311472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:24:43.311472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3 is already attached to instances: 1d377dbb-6731-491e-bc79-3c63e6eb99a0 Aug 31 00:24:43.311472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:43.311472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 400 to user: Invalid volume: volume 0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3 is already attached to instances: 1d377dbb-6731-491e-bc79-3c63e6eb99a0 {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:24:43.311472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-676d6a49-a4d9-499e-9e42-950fcf560399 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125293 Aug 31 00:24:43.311472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 237/455] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:24:43 2022] POST /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 00:24:43.312760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d74b81d5-87d1-4ffb-9621-f926afd9c8a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:43.312760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d74b81d5-87d1-4ffb-9621-f926afd9c8a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:43.319590 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d74b81d5-87d1-4ffb-9621-f926afd9c8a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:43.320393 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d74b81d5-87d1-4ffb-9621-f926afd9c8a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:43.322094 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d74b81d5-87d1-4ffb-9621-f926afd9c8a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:43.324844 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d74b81d5-87d1-4ffb-9621-f926afd9c8a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:43.324844 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d74b81d5-87d1-4ffb-9621-f926afd9c8a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:43.324844 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d74b81d5-87d1-4ffb-9621-f926afd9c8a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:43.356267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d74b81d5-87d1-4ffb-9621-f926afd9c8a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Going to try to terminate instance {{(pid=127118) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:24:43.366383 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f6df49de-7a17-4728-9cf2-9922d7cbc539 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:43.378733 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f6df49de-7a17-4728-9cf2-9922d7cbc539 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.848009 Aug 31 00:24:43.379589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 219/456] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:42 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:43.468040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d74b81d5-87d1-4ffb-9621-f926afd9c8a4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 204 len: 0 microversion: 2.1 time: 0.159504 Aug 31 00:24:43.469909 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 238/457] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:24:43 2022] DELETE /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:24:43.480258 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-556d32a5-a2d5-46af-ab6b-68dc948ea888 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:43.481033 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-556d32a5-a2d5-46af-ab6b-68dc948ea888 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:43.488914 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-556d32a5-a2d5-46af-ab6b-68dc948ea888 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:43.489544 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-556d32a5-a2d5-46af-ab6b-68dc948ea888 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:43.490066 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-556d32a5-a2d5-46af-ab6b-68dc948ea888 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:43.490830 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-556d32a5-a2d5-46af-ab6b-68dc948ea888 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:43.491290 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-556d32a5-a2d5-46af-ab6b-68dc948ea888 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:43.492035 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-556d32a5-a2d5-46af-ab6b-68dc948ea888 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:43.934678 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-38a10889-1ce3-47a6-a13b-66d16dfae015 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:43.935788 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-38a10889-1ce3-47a6-a13b-66d16dfae015 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:43.943936 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-38a10889-1ce3-47a6-a13b-66d16dfae015 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:43.944527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-38a10889-1ce3-47a6-a13b-66d16dfae015 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:43.944968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-38a10889-1ce3-47a6-a13b-66d16dfae015 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:43.945709 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-38a10889-1ce3-47a6-a13b-66d16dfae015 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:43.946171 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-38a10889-1ce3-47a6-a13b-66d16dfae015 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:43.946627 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-38a10889-1ce3-47a6-a13b-66d16dfae015 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:44.491334 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-556d32a5-a2d5-46af-ab6b-68dc948ea888 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:44.496036 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-38a10889-1ce3-47a6-a13b-66d16dfae015 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:44.502143 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-556d32a5-a2d5-46af-ab6b-68dc948ea888 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1681 microversion: 2.1 time: 1.027261 Aug 31 00:24:44.503400 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 220/458] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:43 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1681 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:44.508947 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9324c749-59c7-4b40-a666-a2efb3073f4c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:44.509964 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9324c749-59c7-4b40-a666-a2efb3073f4c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:44.522642 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-38a10889-1ce3-47a6-a13b-66d16dfae015 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1275 microversion: 2.1 time: 0.592367 Aug 31 00:24:44.526213 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9324c749-59c7-4b40-a666-a2efb3073f4c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:44.526213 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9324c749-59c7-4b40-a666-a2efb3073f4c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:44.526852 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 239/459] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:43 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1275 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:44.527255 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9324c749-59c7-4b40-a666-a2efb3073f4c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:44.528080 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9324c749-59c7-4b40-a666-a2efb3073f4c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:44.528653 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9324c749-59c7-4b40-a666-a2efb3073f4c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:44.529185 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9324c749-59c7-4b40-a666-a2efb3073f4c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:45.269209 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9324c749-59c7-4b40-a666-a2efb3073f4c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:45.279814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9324c749-59c7-4b40-a666-a2efb3073f4c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.775234 Aug 31 00:24:45.280469 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 221/460] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:44 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:45.537339 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-67f7a16d-e17f-41a5-89a2-3f49f76a447b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:45.538480 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-67f7a16d-e17f-41a5-89a2-3f49f76a447b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:45.551337 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67f7a16d-e17f-41a5-89a2-3f49f76a447b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:45.552244 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67f7a16d-e17f-41a5-89a2-3f49f76a447b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:45.553664 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67f7a16d-e17f-41a5-89a2-3f49f76a447b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:45.554316 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67f7a16d-e17f-41a5-89a2-3f49f76a447b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:45.555131 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67f7a16d-e17f-41a5-89a2-3f49f76a447b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:45.555874 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e74f72c1-69d6-4e36-8153-6487e4b52b37 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:45.556408 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67f7a16d-e17f-41a5-89a2-3f49f76a447b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:45.556671 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e74f72c1-69d6-4e36-8153-6487e4b52b37 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:45.564570 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e74f72c1-69d6-4e36-8153-6487e4b52b37 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:45.565167 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e74f72c1-69d6-4e36-8153-6487e4b52b37 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:45.566079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e74f72c1-69d6-4e36-8153-6487e4b52b37 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:45.567030 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e74f72c1-69d6-4e36-8153-6487e4b52b37 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:45.567485 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e74f72c1-69d6-4e36-8153-6487e4b52b37 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:45.567916 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e74f72c1-69d6-4e36-8153-6487e4b52b37 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:45.950423 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e74f72c1-69d6-4e36-8153-6487e4b52b37 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:45.959426 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e74f72c1-69d6-4e36-8153-6487e4b52b37 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1275 microversion: 2.1 time: 0.408002 Aug 31 00:24:45.960075 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 222/461] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:45 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1275 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:46.304009 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e0bfddcf-ea84-4dec-8f59-2ad355d88395 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:46.305164 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e0bfddcf-ea84-4dec-8f59-2ad355d88395 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:46.314112 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e0bfddcf-ea84-4dec-8f59-2ad355d88395 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:46.314703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e0bfddcf-ea84-4dec-8f59-2ad355d88395 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:46.315219 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e0bfddcf-ea84-4dec-8f59-2ad355d88395 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:46.316021 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e0bfddcf-ea84-4dec-8f59-2ad355d88395 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:46.316618 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e0bfddcf-ea84-4dec-8f59-2ad355d88395 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:46.317210 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e0bfddcf-ea84-4dec-8f59-2ad355d88395 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:46.763624 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-67f7a16d-e17f-41a5-89a2-3f49f76a447b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:46.772859 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-67f7a16d-e17f-41a5-89a2-3f49f76a447b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1681 microversion: 2.1 time: 1.242533 Aug 31 00:24:46.773471 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 240/462] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:45 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1681 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:46.982682 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2fa3919c-99f1-4aa1-9d13-6fe322c8f8f3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:46.983487 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2fa3919c-99f1-4aa1-9d13-6fe322c8f8f3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:46.995614 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fa3919c-99f1-4aa1-9d13-6fe322c8f8f3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:46.996745 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fa3919c-99f1-4aa1-9d13-6fe322c8f8f3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:46.997597 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fa3919c-99f1-4aa1-9d13-6fe322c8f8f3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:46.999632 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fa3919c-99f1-4aa1-9d13-6fe322c8f8f3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:47.001278 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fa3919c-99f1-4aa1-9d13-6fe322c8f8f3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:47.002149 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2fa3919c-99f1-4aa1-9d13-6fe322c8f8f3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:47.515341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e0bfddcf-ea84-4dec-8f59-2ad355d88395 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:47.527006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e0bfddcf-ea84-4dec-8f59-2ad355d88395 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 1.227811 Aug 31 00:24:47.527778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 223/463] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:46 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:47.802924 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d7330329-c301-4862-897c-825efee1b919 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:47.803766 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d7330329-c301-4862-897c-825efee1b919 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:47.811852 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7330329-c301-4862-897c-825efee1b919 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:47.812557 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7330329-c301-4862-897c-825efee1b919 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:47.813311 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7330329-c301-4862-897c-825efee1b919 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:47.821235 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7330329-c301-4862-897c-825efee1b919 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:47.826450 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7330329-c301-4862-897c-825efee1b919 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:47.827131 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7330329-c301-4862-897c-825efee1b919 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:48.046595 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2fa3919c-99f1-4aa1-9d13-6fe322c8f8f3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:48.058279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2fa3919c-99f1-4aa1-9d13-6fe322c8f8f3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1317 microversion: 2.1 time: 1.079555 Aug 31 00:24:48.059379 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 241/464] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:46 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1317 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:48.450491 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d7330329-c301-4862-897c-825efee1b919 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:48.460534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d7330329-c301-4862-897c-825efee1b919 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1681 microversion: 2.1 time: 0.665004 Aug 31 00:24:48.461283 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 224/465] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:47 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1681 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:48.566814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f3ff9fc6-9a31-4ff3-99ae-50e478461732 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:48.567935 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f3ff9fc6-9a31-4ff3-99ae-50e478461732 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:48.582721 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3ff9fc6-9a31-4ff3-99ae-50e478461732 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:48.583508 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3ff9fc6-9a31-4ff3-99ae-50e478461732 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:48.584346 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3ff9fc6-9a31-4ff3-99ae-50e478461732 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:48.585683 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3ff9fc6-9a31-4ff3-99ae-50e478461732 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:48.586529 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3ff9fc6-9a31-4ff3-99ae-50e478461732 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:48.587813 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3ff9fc6-9a31-4ff3-99ae-50e478461732 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:49.088823 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f3ff9fc6-9a31-4ff3-99ae-50e478461732 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:49.097355 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3359831f-bc5a-44e4-b52d-a24f6bc37502 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:49.098476 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3359831f-bc5a-44e4-b52d-a24f6bc37502 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:49.112717 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f3ff9fc6-9a31-4ff3-99ae-50e478461732 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.553802 Aug 31 00:24:49.114665 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3359831f-bc5a-44e4-b52d-a24f6bc37502 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:49.116495 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3359831f-bc5a-44e4-b52d-a24f6bc37502 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:49.117889 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3359831f-bc5a-44e4-b52d-a24f6bc37502 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:49.119990 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3359831f-bc5a-44e4-b52d-a24f6bc37502 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:49.121207 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3359831f-bc5a-44e4-b52d-a24f6bc37502 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:49.125924 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3359831f-bc5a-44e4-b52d-a24f6bc37502 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:49.127562 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:49.141918 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 242/466] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:48 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:49.165432 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=6 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:49.497396 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8f3cc764-78c3-4f7c-a2d7-1de1b10c2720 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:49.498656 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8f3cc764-78c3-4f7c-a2d7-1de1b10c2720 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:49.502225 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:49.513663 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8f3cc764-78c3-4f7c-a2d7-1de1b10c2720 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:49.514860 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8f3cc764-78c3-4f7c-a2d7-1de1b10c2720 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:49.515485 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8f3cc764-78c3-4f7c-a2d7-1de1b10c2720 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:49.517043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8f3cc764-78c3-4f7c-a2d7-1de1b10c2720 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:49.517795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8f3cc764-78c3-4f7c-a2d7-1de1b10c2720 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:49.518457 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8f3cc764-78c3-4f7c-a2d7-1de1b10c2720 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:49.538757 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:49.958626 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8f3cc764-78c3-4f7c-a2d7-1de1b10c2720 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:49.975738 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8f3cc764-78c3-4f7c-a2d7-1de1b10c2720 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1613 microversion: 2.1 time: 0.482868 Aug 31 00:24:49.977242 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 243/467] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:49 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1613 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:50.036386 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3359831f-bc5a-44e4-b52d-a24f6bc37502 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:50.053838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3359831f-bc5a-44e4-b52d-a24f6bc37502 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1317 microversion: 2.1 time: 0.964860 Aug 31 00:24:50.055815 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 225/468] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:49 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1317 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:50.153174 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-cf511813-3770-4e5a-865f-c955a6317252 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:50.154300 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-cf511813-3770-4e5a-865f-c955a6317252 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:50.164102 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf511813-3770-4e5a-865f-c955a6317252 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:50.164863 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf511813-3770-4e5a-865f-c955a6317252 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:50.165476 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf511813-3770-4e5a-865f-c955a6317252 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:50.166454 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf511813-3770-4e5a-865f-c955a6317252 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:50.167468 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf511813-3770-4e5a-865f-c955a6317252 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:50.168085 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf511813-3770-4e5a-865f-c955a6317252 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:50.536459 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-635cd984-1477-4b2e-8434-93fbb1e0b7e4 req-b4b84171-b09a-4827-9979-405fa019acb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5fa0677-75e7-4b3b-8813-37c81becbd7c", "tag": "a907ffdd-5539-4622-af52-d1af362cf940"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:50.571976 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-635cd984-1477-4b2e-8434-93fbb1e0b7e4 req-b4b84171-b09a-4827-9979-405fa019acb6 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:50.573260 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-635cd984-1477-4b2e-8434-93fbb1e0b7e4 req-b4b84171-b09a-4827-9979-405fa019acb6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:50.574764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-635cd984-1477-4b2e-8434-93fbb1e0b7e4 req-b4b84171-b09a-4827-9979-405fa019acb6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:50.604088 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-635cd984-1477-4b2e-8434-93fbb1e0b7e4 req-b4b84171-b09a-4827-9979-405fa019acb6 service nova] Creating event network-changed:a907ffdd-5539-4622-af52-d1af362cf940 for instance c5fa0677-75e7-4b3b-8813-37c81becbd7c on hv-cinder-85221 Aug 31 00:24:50.637128 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-635cd984-1477-4b2e-8434-93fbb1e0b7e4 req-b4b84171-b09a-4827-9979-405fa019acb6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123027 Aug 31 00:24:50.638671 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 226/469] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:50.890895 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-cf511813-3770-4e5a-865f-c955a6317252 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:50.918183 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-cf511813-3770-4e5a-865f-c955a6317252 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.771446 Aug 31 00:24:50.930321 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 244/470] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:50 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:51.027785 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3799548c-aacf-4544-b5e3-b313c14879f9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:51.029371 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3799548c-aacf-4544-b5e3-b313c14879f9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:51.067854 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3799548c-aacf-4544-b5e3-b313c14879f9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:51.073333 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3799548c-aacf-4544-b5e3-b313c14879f9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:51.076953 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3799548c-aacf-4544-b5e3-b313c14879f9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:51.080967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3799548c-aacf-4544-b5e3-b313c14879f9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:51.090714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f358397d-8a11-4d64-8fc3-691f2edc4aee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:51.092369 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f358397d-8a11-4d64-8fc3-691f2edc4aee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:51.104716 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3799548c-aacf-4544-b5e3-b313c14879f9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:51.106021 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3799548c-aacf-4544-b5e3-b313c14879f9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:51.117933 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:51.121319 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f358397d-8a11-4d64-8fc3-691f2edc4aee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:51.132997 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f358397d-8a11-4d64-8fc3-691f2edc4aee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:51.133724 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f358397d-8a11-4d64-8fc3-691f2edc4aee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:51.134665 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f358397d-8a11-4d64-8fc3-691f2edc4aee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:51.135325 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f358397d-8a11-4d64-8fc3-691f2edc4aee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:51.135992 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f358397d-8a11-4d64-8fc3-691f2edc4aee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:51.458126 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3799548c-aacf-4544-b5e3-b313c14879f9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:51.482089 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3799548c-aacf-4544-b5e3-b313c14879f9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1326 microversion: 2.1 time: 0.469029 Aug 31 00:24:51.504432 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 227/471] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:51 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1326 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:51.793004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f358397d-8a11-4d64-8fc3-691f2edc4aee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:51.822402 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f358397d-8a11-4d64-8fc3-691f2edc4aee tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1317 microversion: 2.1 time: 0.738313 Aug 31 00:24:51.826432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 245/472] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:51 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1317 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:51.981592 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-0ff31b63-de18-4f0e-857f-9643cd8486cb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:51.988027 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-0ff31b63-de18-4f0e-857f-9643cd8486cb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:52.022586 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ff31b63-de18-4f0e-857f-9643cd8486cb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.024284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ff31b63-de18-4f0e-857f-9643cd8486cb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.025833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ff31b63-de18-4f0e-857f-9643cd8486cb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:52.030133 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ff31b63-de18-4f0e-857f-9643cd8486cb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.032698 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ff31b63-de18-4f0e-857f-9643cd8486cb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.034450 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0ff31b63-de18-4f0e-857f-9643cd8486cb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:52.342384 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-0ff31b63-de18-4f0e-857f-9643cd8486cb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:52.354077 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-0ff31b63-de18-4f0e-857f-9643cd8486cb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.380371 Aug 31 00:24:52.368999 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 228/473] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:51 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:52.516292 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:52.517159 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:52.527187 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.528007 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.529012 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:52.530249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.530984 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.532540 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:52.613755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.615181 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.616897 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:52.618329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lazy-loading 'fault' on Instance uuid 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:52.710056 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:52.714908 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-e86b5c55-67e6-4ede-8370-7407b3adff85 req-1e511e32-a932-4fe0-a40a-31091e8ed6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdf4278-aa30-4d1a-8c4d-94afd592aba5", "name": "network-vif-deleted", "tag": "045ec9e3-1f50-4880-9a45-e10e1bd6b41b"}, {"name": "network-changed", "server_uuid": "c95e1f70-6a63-40b2-a053-4b043f6b1ffa", "tag": "c156e592-123d-470f-843d-661d21c8d777"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:52.726707 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4928c95b-6313-4d9a-a4b1-4e75d206cdea tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 200 len: 1331 microversion: 2.1 time: 0.215797 Aug 31 00:24:52.727315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 246/474] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:52 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 1331 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:52.747313 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e86b5c55-67e6-4ede-8370-7407b3adff85 req-1e511e32-a932-4fe0-a40a-31091e8ed6e5 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.748090 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e86b5c55-67e6-4ede-8370-7407b3adff85 req-1e511e32-a932-4fe0-a40a-31091e8ed6e5 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.748615 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e86b5c55-67e6-4ede-8370-7407b3adff85 req-1e511e32-a932-4fe0-a40a-31091e8ed6e5 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:52.766169 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-e86b5c55-67e6-4ede-8370-7407b3adff85 req-1e511e32-a932-4fe0-a40a-31091e8ed6e5 service nova] Creating event network-vif-deleted:045ec9e3-1f50-4880-9a45-e10e1bd6b41b for instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 on hv-cinder-85221 Aug 31 00:24:52.767070 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-e86b5c55-67e6-4ede-8370-7407b3adff85 req-1e511e32-a932-4fe0-a40a-31091e8ed6e5 service nova] Creating event network-changed:c156e592-123d-470f-843d-661d21c8d777 for instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa on hv-cinder-85221 Aug 31 00:24:52.774022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-e86b5c55-67e6-4ede-8370-7407b3adff85 req-1e511e32-a932-4fe0-a40a-31091e8ed6e5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070862 Aug 31 00:24:52.774634 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 229/475] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:24:52.848908 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-41f45ed7-d724-44d8-94d8-d19728f65a2f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:52.850093 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-41f45ed7-d724-44d8-94d8-d19728f65a2f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:52.857700 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-41f45ed7-d724-44d8-94d8-d19728f65a2f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.858391 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-41f45ed7-d724-44d8-94d8-d19728f65a2f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.858932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-41f45ed7-d724-44d8-94d8-d19728f65a2f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:52.860391 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-41f45ed7-d724-44d8-94d8-d19728f65a2f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.860973 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-41f45ed7-d724-44d8-94d8-d19728f65a2f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.861493 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-41f45ed7-d724-44d8-94d8-d19728f65a2f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:53.051803 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-41f45ed7-d724-44d8-94d8-d19728f65a2f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:53.064822 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-41f45ed7-d724-44d8-94d8-d19728f65a2f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1317 microversion: 2.1 time: 0.221421 Aug 31 00:24:53.074543 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 247/476] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:52 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:53.381612 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ce1726ac-a1b2-4f54-b05e-062e2c713e4d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:53.382870 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ce1726ac-a1b2-4f54-b05e-062e2c713e4d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:53.393851 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce1726ac-a1b2-4f54-b05e-062e2c713e4d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:53.394643 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce1726ac-a1b2-4f54-b05e-062e2c713e4d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:53.395371 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce1726ac-a1b2-4f54-b05e-062e2c713e4d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:53.396791 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce1726ac-a1b2-4f54-b05e-062e2c713e4d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:53.397789 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce1726ac-a1b2-4f54-b05e-062e2c713e4d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:53.398860 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ce1726ac-a1b2-4f54-b05e-062e2c713e4d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:53.608221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ce1726ac-a1b2-4f54-b05e-062e2c713e4d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:53.618747 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ce1726ac-a1b2-4f54-b05e-062e2c713e4d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.243192 Aug 31 00:24:53.619356 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 230/477] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:53 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:53.756031 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:53.757715 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:53.772034 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:53.774449 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:53.775256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:53.776660 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:53.777533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:53.778389 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:53.808477 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 HTTP/1.1 Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:24:53.813136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:24:53.816107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '8fdf4278-aa30-4d1a-8c4d-94afd592aba5'} Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:24:53.817775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:24:53.820830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:24:53.824961 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:24:53.825853 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1f40cb37-1246-4f46-b0dc-7e4bbb8e364b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 404 len: 111 microversion: 2.1 time: 0.078932 Aug 31 00:24:53.826439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 248/478] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:53 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:53.837902 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-124f4408-13f2-435d-89c1-2a187384ca8a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '.version_select at 0x7f1a3a965040>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:53.870613 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-124f4408-13f2-435d-89c1-2a187384ca8a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-546715687" status: 202 len: 0 microversion: 2.1 time: 0.037966 Aug 31 00:24:53.876898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 231/479] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Aug 31 00:24:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-546715687 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:24:54.092038 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-45f5b266-20b3-451c-bb81-e6799579b737 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:54.092713 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-45f5b266-20b3-451c-bb81-e6799579b737 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:54.105191 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45f5b266-20b3-451c-bb81-e6799579b737 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:54.106338 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45f5b266-20b3-451c-bb81-e6799579b737 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:54.106338 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45f5b266-20b3-451c-bb81-e6799579b737 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:54.106858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45f5b266-20b3-451c-bb81-e6799579b737 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:54.107320 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45f5b266-20b3-451c-bb81-e6799579b737 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:54.107739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45f5b266-20b3-451c-bb81-e6799579b737 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:54.550458 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-45f5b266-20b3-451c-bb81-e6799579b737 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:54.567770 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-45f5b266-20b3-451c-bb81-e6799579b737 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1317 microversion: 2.1 time: 0.479192 Aug 31 00:24:54.569224 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 249/480] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:54 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:54.643242 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2a1179b8-cc0b-43d8-a40a-c42d7a3191ec tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:54.644132 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2a1179b8-cc0b-43d8-a40a-c42d7a3191ec tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:54.660484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a1179b8-cc0b-43d8-a40a-c42d7a3191ec tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:54.661412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a1179b8-cc0b-43d8-a40a-c42d7a3191ec tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:54.663126 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a1179b8-cc0b-43d8-a40a-c42d7a3191ec tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:54.664854 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a1179b8-cc0b-43d8-a40a-c42d7a3191ec tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:54.665721 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a1179b8-cc0b-43d8-a40a-c42d7a3191ec tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:54.666495 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a1179b8-cc0b-43d8-a40a-c42d7a3191ec tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:55.073760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-53953508-abbf-42d3-a8b6-3acfb7e5af18 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:55.074581 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-53953508-abbf-42d3-a8b6-3acfb7e5af18 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:55.086772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-53953508-abbf-42d3-a8b6-3acfb7e5af18 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:55.087647 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-53953508-abbf-42d3-a8b6-3acfb7e5af18 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:55.088481 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-53953508-abbf-42d3-a8b6-3acfb7e5af18 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:55.089782 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-53953508-abbf-42d3-a8b6-3acfb7e5af18 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:55.090631 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-53953508-abbf-42d3-a8b6-3acfb7e5af18 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:55.091360 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-53953508-abbf-42d3-a8b6-3acfb7e5af18 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:55.100503 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2a1179b8-cc0b-43d8-a40a-c42d7a3191ec tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:55.111575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2a1179b8-cc0b-43d8-a40a-c42d7a3191ec tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.473296 Aug 31 00:24:55.112223 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 232/481] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:54 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:55.199239 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-53953508-abbf-42d3-a8b6-3acfb7e5af18 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lazy-loading 'services' on Instance uuid 1d377dbb-6731-491e-bc79-3c63e6eb99a0 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:55.287215 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-53953508-abbf-42d3-a8b6-3acfb7e5af18 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-volume_attachments/0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3" status: 202 len: 0 microversion: 2.1 time: 0.220892 Aug 31 00:24:55.287824 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 250/482] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:24:55 2022] DELETE /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-volume_attachments/0e8f8859-04bf-4d1c-b1de-bca20b5ee5b3 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:24:55.298021 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-428f501d-868a-4f05-a62d-73298235cc21 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:55.301260 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-428f501d-868a-4f05-a62d-73298235cc21 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:55.308033 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-428f501d-868a-4f05-a62d-73298235cc21 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:55.309113 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-428f501d-868a-4f05-a62d-73298235cc21 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:55.309562 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-428f501d-868a-4f05-a62d-73298235cc21 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:55.310297 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-428f501d-868a-4f05-a62d-73298235cc21 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:55.315452 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-428f501d-868a-4f05-a62d-73298235cc21 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:55.315452 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-428f501d-868a-4f05-a62d-73298235cc21 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:55.366877 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-428f501d-868a-4f05-a62d-73298235cc21 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074026 Aug 31 00:24:55.367484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 233/483] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:24:55 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:55.595825 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0872d76f-e4b6-4021-acf2-7ef364313f93 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:55.596781 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0872d76f-e4b6-4021-acf2-7ef364313f93 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:55.604459 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0872d76f-e4b6-4021-acf2-7ef364313f93 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:55.604973 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0872d76f-e4b6-4021-acf2-7ef364313f93 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:55.605412 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0872d76f-e4b6-4021-acf2-7ef364313f93 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:55.606158 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0872d76f-e4b6-4021-acf2-7ef364313f93 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:55.606622 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0872d76f-e4b6-4021-acf2-7ef364313f93 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:55.607043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0872d76f-e4b6-4021-acf2-7ef364313f93 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:55.767966 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0872d76f-e4b6-4021-acf2-7ef364313f93 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:55.779003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0872d76f-e4b6-4021-acf2-7ef364313f93 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1317 microversion: 2.1 time: 0.188329 Aug 31 00:24:55.779696 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 251/484] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:55 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:56.149796 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4008060c-bf95-47b9-803a-edc15fc1024d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:56.150727 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4008060c-bf95-47b9-803a-edc15fc1024d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:56.159738 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4008060c-bf95-47b9-803a-edc15fc1024d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:56.160272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4008060c-bf95-47b9-803a-edc15fc1024d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:56.160713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4008060c-bf95-47b9-803a-edc15fc1024d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:56.161565 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4008060c-bf95-47b9-803a-edc15fc1024d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:56.162070 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4008060c-bf95-47b9-803a-edc15fc1024d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:56.162500 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4008060c-bf95-47b9-803a-edc15fc1024d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:56.329447 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4008060c-bf95-47b9-803a-edc15fc1024d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:56.340265 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4008060c-bf95-47b9-803a-edc15fc1024d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.197138 Aug 31 00:24:56.341138 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 234/485] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:56 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:56.362968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-2f4fc8f3-4fc4-444e-bbe6-8bb87365b555 req-ddd9d135-5aeb-4397-9403-c38ff9fd7eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5fa0677-75e7-4b3b-8813-37c81becbd7c", "name": "network-vif-plugged", "status": "completed", "tag": "a907ffdd-5539-4622-af52-d1af362cf940"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:56.381002 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-2f4fc8f3-4fc4-444e-bbe6-8bb87365b555 req-ddd9d135-5aeb-4397-9403-c38ff9fd7eb6 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:56.382606 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-2f4fc8f3-4fc4-444e-bbe6-8bb87365b555 req-ddd9d135-5aeb-4397-9403-c38ff9fd7eb6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:56.383677 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-2f4fc8f3-4fc4-444e-bbe6-8bb87365b555 req-ddd9d135-5aeb-4397-9403-c38ff9fd7eb6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:56.388050 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a01a3ba1-de1f-440d-940c-c4c11a98e892 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:56.392524 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-a01a3ba1-de1f-440d-940c-c4c11a98e892 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:56.405468 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a01a3ba1-de1f-440d-940c-c4c11a98e892 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:56.406342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a01a3ba1-de1f-440d-940c-c4c11a98e892 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:56.407261 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a01a3ba1-de1f-440d-940c-c4c11a98e892 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:56.408740 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a01a3ba1-de1f-440d-940c-c4c11a98e892 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:56.409703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a01a3ba1-de1f-440d-940c-c4c11a98e892 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:56.410806 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a01a3ba1-de1f-440d-940c-c4c11a98e892 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:56.411565 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-2f4fc8f3-4fc4-444e-bbe6-8bb87365b555 req-ddd9d135-5aeb-4397-9403-c38ff9fd7eb6 service nova] Creating event network-vif-plugged:a907ffdd-5539-4622-af52-d1af362cf940 for instance c5fa0677-75e7-4b3b-8813-37c81becbd7c on hv-cinder-85221 Aug 31 00:24:56.426087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-2f4fc8f3-4fc4-444e-bbe6-8bb87365b555 req-ddd9d135-5aeb-4397-9403-c38ff9fd7eb6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069501 Aug 31 00:24:56.427846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 252/486] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:56.463331 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a01a3ba1-de1f-440d-940c-c4c11a98e892 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084605 Aug 31 00:24:56.464196 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 235/487] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:24:56 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:56.803725 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-48050e68-2072-49b3-bce7-37e15494820d tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:56.804506 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-48050e68-2072-49b3-bce7-37e15494820d tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:56.811214 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-48050e68-2072-49b3-bce7-37e15494820d tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:56.811695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-48050e68-2072-49b3-bce7-37e15494820d tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:56.812130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-48050e68-2072-49b3-bce7-37e15494820d tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:56.813224 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-48050e68-2072-49b3-bce7-37e15494820d tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:56.813860 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-48050e68-2072-49b3-bce7-37e15494820d tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:56.814333 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-48050e68-2072-49b3-bce7-37e15494820d tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:56.972423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-48050e68-2072-49b3-bce7-37e15494820d tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:56.981347 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-48050e68-2072-49b3-bce7-37e15494820d tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1317 microversion: 2.1 time: 0.181985 Aug 31 00:24:56.982028 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 253/488] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:56 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:57.365239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-952c35ec-5819-423d-b053-81e7aecef869 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:57.366072 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-952c35ec-5819-423d-b053-81e7aecef869 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:57.373472 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-952c35ec-5819-423d-b053-81e7aecef869 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:57.373975 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-952c35ec-5819-423d-b053-81e7aecef869 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:57.374429 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-952c35ec-5819-423d-b053-81e7aecef869 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:57.375161 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-952c35ec-5819-423d-b053-81e7aecef869 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:57.375625 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-952c35ec-5819-423d-b053-81e7aecef869 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:57.376235 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-952c35ec-5819-423d-b053-81e7aecef869 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:57.480873 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-71f8be99-b689-40bb-b1cb-4566d5e572b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:57.483517 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-71f8be99-b689-40bb-b1cb-4566d5e572b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:57.491799 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71f8be99-b689-40bb-b1cb-4566d5e572b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:57.492479 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71f8be99-b689-40bb-b1cb-4566d5e572b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:57.493024 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71f8be99-b689-40bb-b1cb-4566d5e572b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:57.493874 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71f8be99-b689-40bb-b1cb-4566d5e572b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:57.494427 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71f8be99-b689-40bb-b1cb-4566d5e572b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:57.495034 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71f8be99-b689-40bb-b1cb-4566d5e572b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:57.549543 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-71f8be99-b689-40bb-b1cb-4566d5e572b8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075016 Aug 31 00:24:57.550666 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 254/489] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:24:57 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:24:57.561446 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-952c35ec-5819-423d-b053-81e7aecef869 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:57.574258 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-952c35ec-5819-423d-b053-81e7aecef869 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.213283 Aug 31 00:24:57.575394 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 236/490] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:57 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:57.639428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c0a1947f-3bd3-4837-9fb8-c27ba11be1c6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:57.639947 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c0a1947f-3bd3-4837-9fb8-c27ba11be1c6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:57.650465 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c0a1947f-3bd3-4837-9fb8-c27ba11be1c6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:57.651309 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c0a1947f-3bd3-4837-9fb8-c27ba11be1c6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:57.652065 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c0a1947f-3bd3-4837-9fb8-c27ba11be1c6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:57.653411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c0a1947f-3bd3-4837-9fb8-c27ba11be1c6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:57.654153 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c0a1947f-3bd3-4837-9fb8-c27ba11be1c6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:57.654891 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c0a1947f-3bd3-4837-9fb8-c27ba11be1c6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:57.698139 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c0a1947f-3bd3-4837-9fb8-c27ba11be1c6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Going to try to terminate instance {{(pid=127118) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:24:57.801553 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c0a1947f-3bd3-4837-9fb8-c27ba11be1c6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 204 len: 0 microversion: 2.1 time: 0.165902 Aug 31 00:24:57.802612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 255/491] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:24:57 2022] DELETE /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:24:57.811519 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-80320449-8816-4842-91c4-8c0658f038ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:57.812204 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-80320449-8816-4842-91c4-8c0658f038ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:57.819842 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-80320449-8816-4842-91c4-8c0658f038ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:57.820483 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-80320449-8816-4842-91c4-8c0658f038ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:57.821074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-80320449-8816-4842-91c4-8c0658f038ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:57.822053 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-80320449-8816-4842-91c4-8c0658f038ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:57.822633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-80320449-8816-4842-91c4-8c0658f038ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:57.823174 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-80320449-8816-4842-91c4-8c0658f038ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:57.977652 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-80320449-8816-4842-91c4-8c0658f038ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:57.986779 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-80320449-8816-4842-91c4-8c0658f038ed tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1682 microversion: 2.1 time: 0.179126 Aug 31 00:24:57.987438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 237/492] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:57 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:58.007603 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b2fd5279-d038-4a75-b8b6-401e08a394b9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:58.008275 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b2fd5279-d038-4a75-b8b6-401e08a394b9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:58.014869 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b2fd5279-d038-4a75-b8b6-401e08a394b9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:58.015355 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b2fd5279-d038-4a75-b8b6-401e08a394b9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:58.016025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b2fd5279-d038-4a75-b8b6-401e08a394b9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:58.016836 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b2fd5279-d038-4a75-b8b6-401e08a394b9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:58.017296 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b2fd5279-d038-4a75-b8b6-401e08a394b9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:58.017798 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b2fd5279-d038-4a75-b8b6-401e08a394b9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:58.179167 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b2fd5279-d038-4a75-b8b6-401e08a394b9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:58.188999 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b2fd5279-d038-4a75-b8b6-401e08a394b9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1317 microversion: 2.1 time: 0.186097 Aug 31 00:24:58.189766 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 256/493] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:58 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:58.601601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-bcd2ba40-5de6-4b38-9bf8-0867a5d22201 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:58.602619 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-bcd2ba40-5de6-4b38-9bf8-0867a5d22201 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:58.610569 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcd2ba40-5de6-4b38-9bf8-0867a5d22201 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:58.611173 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcd2ba40-5de6-4b38-9bf8-0867a5d22201 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:58.611779 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcd2ba40-5de6-4b38-9bf8-0867a5d22201 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:58.612776 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcd2ba40-5de6-4b38-9bf8-0867a5d22201 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:58.613294 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcd2ba40-5de6-4b38-9bf8-0867a5d22201 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:58.613999 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcd2ba40-5de6-4b38-9bf8-0867a5d22201 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:58.774772 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-bcd2ba40-5de6-4b38-9bf8-0867a5d22201 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:58.792127 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-bcd2ba40-5de6-4b38-9bf8-0867a5d22201 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.194795 Aug 31 00:24:58.793231 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 238/494] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:58 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:59.009078 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f4b0a409-dd0c-414a-b764-be7abcc44347 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:59.009706 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f4b0a409-dd0c-414a-b764-be7abcc44347 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:59.016970 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f4b0a409-dd0c-414a-b764-be7abcc44347 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:59.017466 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f4b0a409-dd0c-414a-b764-be7abcc44347 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:59.017904 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f4b0a409-dd0c-414a-b764-be7abcc44347 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:59.018627 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f4b0a409-dd0c-414a-b764-be7abcc44347 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:59.019083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f4b0a409-dd0c-414a-b764-be7abcc44347 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:59.019509 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f4b0a409-dd0c-414a-b764-be7abcc44347 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:59.172963 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f4b0a409-dd0c-414a-b764-be7abcc44347 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:59.181817 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f4b0a409-dd0c-414a-b764-be7abcc44347 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1682 microversion: 2.1 time: 0.176605 Aug 31 00:24:59.182491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 257/495] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:59 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:59.211211 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-699e3855-c978-4a0b-962a-80fb96c675e2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:59.211960 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-699e3855-c978-4a0b-962a-80fb96c675e2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:59.219283 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-699e3855-c978-4a0b-962a-80fb96c675e2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:59.220127 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-699e3855-c978-4a0b-962a-80fb96c675e2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:59.220767 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-699e3855-c978-4a0b-962a-80fb96c675e2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:59.221615 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-699e3855-c978-4a0b-962a-80fb96c675e2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:59.222185 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-699e3855-c978-4a0b-962a-80fb96c675e2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:59.222726 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-699e3855-c978-4a0b-962a-80fb96c675e2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:59.377147 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-699e3855-c978-4a0b-962a-80fb96c675e2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:59.386345 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-699e3855-c978-4a0b-962a-80fb96c675e2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1317 microversion: 2.1 time: 0.179100 Aug 31 00:24:59.387037 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 239/496] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:59 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:59.830713 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2338b520-63ed-4e2f-a054-f815a2da3c21 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:59.831515 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2338b520-63ed-4e2f-a054-f815a2da3c21 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:59.839343 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2338b520-63ed-4e2f-a054-f815a2da3c21 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:59.840019 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2338b520-63ed-4e2f-a054-f815a2da3c21 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:59.840735 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2338b520-63ed-4e2f-a054-f815a2da3c21 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:59.841628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2338b520-63ed-4e2f-a054-f815a2da3c21 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:59.842224 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2338b520-63ed-4e2f-a054-f815a2da3c21 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:59.842781 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2338b520-63ed-4e2f-a054-f815a2da3c21 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:00.020313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2338b520-63ed-4e2f-a054-f815a2da3c21 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:00.023153 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:00.032792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2338b520-63ed-4e2f-a054-f815a2da3c21 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.207438 Aug 31 00:25:00.033397 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 258/497] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:59 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:00.206233 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3f7d5d59-1193-43a2-875e-b9d6581e9474 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:00.207105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3f7d5d59-1193-43a2-875e-b9d6581e9474 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:00.213834 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f7d5d59-1193-43a2-875e-b9d6581e9474 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:00.214327 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f7d5d59-1193-43a2-875e-b9d6581e9474 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:00.214764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f7d5d59-1193-43a2-875e-b9d6581e9474 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:00.215475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f7d5d59-1193-43a2-875e-b9d6581e9474 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:00.215931 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f7d5d59-1193-43a2-875e-b9d6581e9474 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:00.216418 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3f7d5d59-1193-43a2-875e-b9d6581e9474 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:00.410943 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7d777311-88da-4cb9-b1cd-7f86a9ede64f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:00.411764 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7d777311-88da-4cb9-b1cd-7f86a9ede64f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:00.421323 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7d777311-88da-4cb9-b1cd-7f86a9ede64f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:00.422718 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7d777311-88da-4cb9-b1cd-7f86a9ede64f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:00.423535 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3f7d5d59-1193-43a2-875e-b9d6581e9474 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:00.423734 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7d777311-88da-4cb9-b1cd-7f86a9ede64f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:00.424428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7d777311-88da-4cb9-b1cd-7f86a9ede64f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:00.425041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7d777311-88da-4cb9-b1cd-7f86a9ede64f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:00.425602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7d777311-88da-4cb9-b1cd-7f86a9ede64f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:00.439737 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3f7d5d59-1193-43a2-875e-b9d6581e9474 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1682 microversion: 2.1 time: 0.238272 Aug 31 00:25:00.441037 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 240/498] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:00 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:00.594334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7d777311-88da-4cb9-b1cd-7f86a9ede64f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:00.604025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7d777311-88da-4cb9-b1cd-7f86a9ede64f tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1505 microversion: 2.1 time: 0.198376 Aug 31 00:25:00.604970 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 259/499] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:00 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:00.628653 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1089a152-0e0d-4dad-bb89-0cc75b9baec3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "224ce0b1-f374-4cc4-8681-1da150079c8d", "device": "/dev/sdb"}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:00.631659 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1089a152-0e0d-4dad-bb89-0cc75b9baec3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:00.638374 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1089a152-0e0d-4dad-bb89-0cc75b9baec3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:00.638875 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1089a152-0e0d-4dad-bb89-0cc75b9baec3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:00.639317 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1089a152-0e0d-4dad-bb89-0cc75b9baec3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:00.640038 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1089a152-0e0d-4dad-bb89-0cc75b9baec3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:00.641482 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1089a152-0e0d-4dad-bb89-0cc75b9baec3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:00.641943 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1089a152-0e0d-4dad-bb89-0cc75b9baec3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:01.058937 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d8d52754-515a-4404-b6df-2e97ac8df14b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:01.060892 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d8d52754-515a-4404-b6df-2e97ac8df14b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:01.077156 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d52754-515a-4404-b6df-2e97ac8df14b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:01.080034 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d52754-515a-4404-b6df-2e97ac8df14b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:01.081236 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d52754-515a-4404-b6df-2e97ac8df14b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:01.082522 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d52754-515a-4404-b6df-2e97ac8df14b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:01.083331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d52754-515a-4404-b6df-2e97ac8df14b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:01.084103 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d52754-515a-4404-b6df-2e97ac8df14b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:01.337598 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d8d52754-515a-4404-b6df-2e97ac8df14b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:01.353447 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d8d52754-515a-4404-b6df-2e97ac8df14b tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.301692 Aug 31 00:25:01.355259 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 260/500] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:01 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:01.474511 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-17a8c683-2079-4516-a52e-460af7c5f8db tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:01.475418 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-17a8c683-2079-4516-a52e-460af7c5f8db tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:01.482727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-17a8c683-2079-4516-a52e-460af7c5f8db tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:01.483502 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-17a8c683-2079-4516-a52e-460af7c5f8db tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:01.486631 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-17a8c683-2079-4516-a52e-460af7c5f8db tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:01.488323 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-17a8c683-2079-4516-a52e-460af7c5f8db tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:01.489382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-17a8c683-2079-4516-a52e-460af7c5f8db tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:01.489962 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-17a8c683-2079-4516-a52e-460af7c5f8db tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:01.511850 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1089a152-0e0d-4dad-bb89-0cc75b9baec3 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "POST /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888375 Aug 31 00:25:01.513548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 241/501] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:25:00 2022] POST /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:02.116108 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-17a8c683-2079-4516-a52e-460af7c5f8db tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:02.126983 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-17a8c683-2079-4516-a52e-460af7c5f8db tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1682 microversion: 2.1 time: 0.658419 Aug 31 00:25:02.127798 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 261/502] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:01 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1682 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:02.380446 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9396397c-6c5b-4e34-8c0a-29f5aa1a8989 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:02.381706 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9396397c-6c5b-4e34-8c0a-29f5aa1a8989 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:02.390297 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9396397c-6c5b-4e34-8c0a-29f5aa1a8989 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:02.391474 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9396397c-6c5b-4e34-8c0a-29f5aa1a8989 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:02.391983 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9396397c-6c5b-4e34-8c0a-29f5aa1a8989 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:02.392845 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9396397c-6c5b-4e34-8c0a-29f5aa1a8989 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:02.393384 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9396397c-6c5b-4e34-8c0a-29f5aa1a8989 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:02.394365 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9396397c-6c5b-4e34-8c0a-29f5aa1a8989 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:02.782442 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9396397c-6c5b-4e34-8c0a-29f5aa1a8989 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:02.795392 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9396397c-6c5b-4e34-8c0a-29f5aa1a8989 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.419533 Aug 31 00:25:02.796254 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 242/503] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:02 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:03.193052 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-c4f9adf8-954a-4730-8bb5-24dff52e68d6 req-7486a09c-e203-4ae5-969a-7c93e86c00a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d377dbb-6731-491e-bc79-3c63e6eb99a0", "name": "network-vif-deleted", "tag": "7e5edb05-f5b5-4c24-a6ca-7eb658fb8ce2"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:03.197966 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-be5f0cba-a629-40a0-8862-c728e61ce7d8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:03.199475 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-be5f0cba-a629-40a0-8862-c728e61ce7d8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:03.224534 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:03.228823 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be5f0cba-a629-40a0-8862-c728e61ce7d8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:03.229932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be5f0cba-a629-40a0-8862-c728e61ce7d8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:03.230528 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be5f0cba-a629-40a0-8862-c728e61ce7d8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:03.231531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be5f0cba-a629-40a0-8862-c728e61ce7d8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:03.253537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be5f0cba-a629-40a0-8862-c728e61ce7d8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:03.256017 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-c4f9adf8-954a-4730-8bb5-24dff52e68d6 req-7486a09c-e203-4ae5-969a-7c93e86c00a9 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:03.257962 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be5f0cba-a629-40a0-8862-c728e61ce7d8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:03.264238 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-c4f9adf8-954a-4730-8bb5-24dff52e68d6 req-7486a09c-e203-4ae5-969a-7c93e86c00a9 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:03.265046 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-c4f9adf8-954a-4730-8bb5-24dff52e68d6 req-7486a09c-e203-4ae5-969a-7c93e86c00a9 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:03.314171 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-c4f9adf8-954a-4730-8bb5-24dff52e68d6 req-7486a09c-e203-4ae5-969a-7c93e86c00a9 service nova] Creating event network-vif-deleted:7e5edb05-f5b5-4c24-a6ca-7eb658fb8ce2 for instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 on hv-cinder-85221 Aug 31 00:25:03.326992 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-c4f9adf8-954a-4730-8bb5-24dff52e68d6 req-7486a09c-e203-4ae5-969a-7c93e86c00a9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142894 Aug 31 00:25:03.330120 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 243/504] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:03.399999 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-be5f0cba-a629-40a0-8862-c728e61ce7d8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:03.411184 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-be5f0cba-a629-40a0-8862-c728e61ce7d8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1326 microversion: 2.1 time: 0.247316 Aug 31 00:25:03.411815 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 262/505] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:03 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1326 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:03.840998 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-76a35781-0960-4bd0-ac59-9fc719a53bb9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:03.842030 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-76a35781-0960-4bd0-ac59-9fc719a53bb9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:03.853473 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-76a35781-0960-4bd0-ac59-9fc719a53bb9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:03.854813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-76a35781-0960-4bd0-ac59-9fc719a53bb9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:03.856443 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-76a35781-0960-4bd0-ac59-9fc719a53bb9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:03.858340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-76a35781-0960-4bd0-ac59-9fc719a53bb9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:03.859983 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-76a35781-0960-4bd0-ac59-9fc719a53bb9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:03.860833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-76a35781-0960-4bd0-ac59-9fc719a53bb9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:04.101049 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-76a35781-0960-4bd0-ac59-9fc719a53bb9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:04.107162 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:04.114960 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-76a35781-0960-4bd0-ac59-9fc719a53bb9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1736 microversion: 2.1 time: 0.280738 Aug 31 00:25:04.115793 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 244/506] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:03 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1736 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:04.435399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:04.437205 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:04.445427 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:04.445947 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:04.446631 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:04.447621 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:04.448115 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:04.448835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:04.494119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:04.494611 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:04.495053 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:04.495707 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lazy-loading 'fault' on Instance uuid 1d377dbb-6731-491e-bc79-3c63e6eb99a0 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:04.583203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:04.611378 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d8d833ba-c7cf-4aff-99e1-d705c999c2e4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1331 microversion: 2.1 time: 0.180598 Aug 31 00:25:04.612076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 263/507] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:04 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1331 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:05.151012 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-72e910c7-171a-431b-8f2a-8114bddffc34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:05.151639 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-72e910c7-171a-431b-8f2a-8114bddffc34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:05.160976 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72e910c7-171a-431b-8f2a-8114bddffc34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.161504 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72e910c7-171a-431b-8f2a-8114bddffc34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.161957 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72e910c7-171a-431b-8f2a-8114bddffc34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.162718 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72e910c7-171a-431b-8f2a-8114bddffc34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.163187 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72e910c7-171a-431b-8f2a-8114bddffc34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.163625 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72e910c7-171a-431b-8f2a-8114bddffc34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.342705 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-72e910c7-171a-431b-8f2a-8114bddffc34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:05.352508 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-72e910c7-171a-431b-8f2a-8114bddffc34 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1716 microversion: 2.1 time: 0.205940 Aug 31 00:25:05.353122 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 245/508] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:05 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1716 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:05.485602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:05.486237 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:05.494025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.494847 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.495654 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.496585 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.497152 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.497678 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.602666 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] HTTP exception thrown: Cannot 'detach_volume' instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 while it is in vm_state rescued Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Request method failure captured: Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: DELETE /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments/cc8320c0-5911-4a69-a1bc-f73992b64e41 HTTP/1.1 Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYalK_ZiTauZ-9XDO7haKEIuXnKbHhABMonOFQP-rI78FINZ2XVrTy8p1zk3RjEkVar9pkgMdmtZNVYMAs-uZPoCRzB4Th807o4TLWVOTd_MNqGbppsFiV6_vn3vGaC-JcYOQFNXv-OJkCGApOtlB6lTEq6yiN8b9AAW0Sat2RBB8 Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: af873e6a013c457aa2407fb24423ddc1 Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:25:05.605719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:25:05.608864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_af873e6a013c457aa2407fb24423ddc1"}]}] Aug 31 00:25:05.608864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:25:05.608864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: af873e6a013c457aa2407fb24423ddc1 Aug 31 00:25:05.608864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:25:05.608864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-ServerRescueNegativeTestJSON-1960179446-project Aug 31 00:25:05.608864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:25:05.608864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:25:05.608864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: f8ffd2d3c0c141118a7a9a5696c383e1 Aug 31 00:25:05.608864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1960179446-project Aug 31 00:25:05.608864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:25:05.608864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Cannot 'detach_volume' instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 while it is in vm_state rescued Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'server_id': '76e8d6e3-f38c-4d75-8f36-60f17fec87a4', 'id': 'cc8320c0-5911-4a69-a1bc-f73992b64e41'} Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:25:05.610366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 while it is in vm_state rescued Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 while it is in vm_state rescued Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:05.617037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Returning 409 to user: Cannot 'detach_volume' instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 while it is in vm_state rescued {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:25:05.618846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4c97eeb7-eae4-40fa-9327-b6e22bc69600 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "DELETE /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments/cc8320c0-5911-4a69-a1bc-f73992b64e41" status: 409 len: 152 microversion: 2.1 time: 0.128652 Aug 31 00:25:05.618846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 264/509] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:25:05 2022] DELETE /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments/cc8320c0-5911-4a69-a1bc-f73992b64e41 => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 00:25:05.625545 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f14c003a-2e90-4e6e-8225-d113e4e32ad1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:05.626738 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f14c003a-2e90-4e6e-8225-d113e4e32ad1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:05.637583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f14c003a-2e90-4e6e-8225-d113e4e32ad1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.638274 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f14c003a-2e90-4e6e-8225-d113e4e32ad1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.638628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f14c003a-2e90-4e6e-8225-d113e4e32ad1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.639583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f14c003a-2e90-4e6e-8225-d113e4e32ad1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.640841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f14c003a-2e90-4e6e-8225-d113e4e32ad1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.641469 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f14c003a-2e90-4e6e-8225-d113e4e32ad1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.649962 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:05.651261 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:05.660470 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.661202 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.661707 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.662651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.663172 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.663648 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.703198 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.703695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.704195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.704747 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lazy-loading 'fault' on Instance uuid 1d377dbb-6731-491e-bc79-3c63e6eb99a0 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:05.760677 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:05.763757 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f14c003a-2e90-4e6e-8225-d113e4e32ad1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "POST /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/action" status: 202 len: 0 microversion: 2.1 time: 0.145857 Aug 31 00:25:05.764924 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 246/510] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:25:05 2022] POST /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:25:05.776520 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1bef0f1f-d312-4484-b107-1bb0193ebbd9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 200 len: 1331 microversion: 2.1 time: 0.132111 Aug 31 00:25:05.777384 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 265/511] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:05 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:05.779934 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3c3c1a30-a439-46a9-922b-783138bb73c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:05.781281 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3c3c1a30-a439-46a9-922b-783138bb73c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:05.792974 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3c3c1a30-a439-46a9-922b-783138bb73c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.793889 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3c3c1a30-a439-46a9-922b-783138bb73c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.794687 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3c3c1a30-a439-46a9-922b-783138bb73c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.795997 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3c3c1a30-a439-46a9-922b-783138bb73c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.796903 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3c3c1a30-a439-46a9-922b-783138bb73c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.797535 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3c3c1a30-a439-46a9-922b-783138bb73c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.988428 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3c3c1a30-a439-46a9-922b-783138bb73c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:05.998028 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3c3c1a30-a439-46a9-922b-783138bb73c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1724 microversion: 2.1 time: 0.226351 Aug 31 00:25:05.998636 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 247/512] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:05 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:06.808419 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:06.809542 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:06.822604 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:06.823369 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:06.824058 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:06.825219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:06.825939 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:06.826597 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:06.844956 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 HTTP/1.1 Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:25:06.846463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:25:06.848804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '1d377dbb-6731-491e-bc79-3c63e6eb99a0'} Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:25:06.849808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:25:06.851839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:06.854119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:25:06.854119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9ea8d11b-dcf0-43c8-a394-7fd2c6834de0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 404 len: 111 microversion: 2.1 time: 0.047444 Aug 31 00:25:06.854119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 266/513] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:06 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:25:06.860913 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b8101127-e26a-4d93-a567-54c8feb3ebd1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '.version_select at 0x7f1a3a92f670>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:06.884406 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b8101127-e26a-4d93-a567-54c8feb3ebd1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384397367" status: 202 len: 0 microversion: 2.1 time: 0.028802 Aug 31 00:25:06.885192 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 248/514] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Aug 31 00:25:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384397367 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:25:07.026201 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d5bc89b8-b898-4d08-814f-1e1fcd55360c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:07.027332 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d5bc89b8-b898-4d08-814f-1e1fcd55360c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:07.038402 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5bc89b8-b898-4d08-814f-1e1fcd55360c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.039282 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5bc89b8-b898-4d08-814f-1e1fcd55360c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.040088 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5bc89b8-b898-4d08-814f-1e1fcd55360c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.041501 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5bc89b8-b898-4d08-814f-1e1fcd55360c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.042384 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5bc89b8-b898-4d08-814f-1e1fcd55360c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.043140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5bc89b8-b898-4d08-814f-1e1fcd55360c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.308583 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d5bc89b8-b898-4d08-814f-1e1fcd55360c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:07.319431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d5bc89b8-b898-4d08-814f-1e1fcd55360c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1724 microversion: 2.1 time: 0.300830 Aug 31 00:25:07.320299 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 267/515] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:07 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:07.473675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f3cee17a-c2c4-4ff8-9cd6-22ea1bd2d302 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:07.474555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f3cee17a-c2c4-4ff8-9cd6-22ea1bd2d302 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:07.486874 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f3cee17a-c2c4-4ff8-9cd6-22ea1bd2d302 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.487771 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f3cee17a-c2c4-4ff8-9cd6-22ea1bd2d302 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.488609 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f3cee17a-c2c4-4ff8-9cd6-22ea1bd2d302 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.489937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f3cee17a-c2c4-4ff8-9cd6-22ea1bd2d302 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.490779 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f3cee17a-c2c4-4ff8-9cd6-22ea1bd2d302 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.491520 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f3cee17a-c2c4-4ff8-9cd6-22ea1bd2d302 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.538178 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f3cee17a-c2c4-4ff8-9cd6-22ea1bd2d302 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments/7cc7d608-159c-4843-8222-1e5d9eaaf833" status: 200 len: 194 microversion: 2.20 time: 0.072718 Aug 31 00:25:07.538903 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 249/516] 10.222.0.47 () {60 vars in 1454 bytes} [Wed Aug 31 00:25:07 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments/7cc7d608-159c-4843-8222-1e5d9eaaf833 => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:25:07.645792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9a4c81d9-30b8-4a9a-bfc8-d0c098bbeca0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:07.646664 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9a4c81d9-30b8-4a9a-bfc8-d0c098bbeca0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:07.655933 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9a4c81d9-30b8-4a9a-bfc8-d0c098bbeca0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.656747 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9a4c81d9-30b8-4a9a-bfc8-d0c098bbeca0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.657256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9a4c81d9-30b8-4a9a-bfc8-d0c098bbeca0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.658460 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9a4c81d9-30b8-4a9a-bfc8-d0c098bbeca0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.659098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9a4c81d9-30b8-4a9a-bfc8-d0c098bbeca0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.659577 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9a4c81d9-30b8-4a9a-bfc8-d0c098bbeca0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.769446 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-72db1ead-39b0-4698-b11a-cc2b0fb5ec34 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: .version_select at 0x7f1a3a92fdc0>, body: {"keypair": {"name": "tempest-keypair-8222539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoSv6cJuffwBWC7wEtMZyZvW+Nq84gzTDPZ9Gpa1VhDINSG3Yz/E7TCBUjzqEWFS9so9K0A8uhoazMjFfcxTiiYCjWuOJWfHrBfE+i0k0I5/PJPi5+GMEJVnwofQnPf6Q=="}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:07.785241 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-9a4c81d9-30b8-4a9a-bfc8-d0c098bbeca0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lazy-loading 'services' on Instance uuid e3a312d8-6cb2-4da8-a19b-215372294799 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:07.790924 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-72db1ead-39b0-4698-b11a-cc2b0fb5ec34 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:25:07.795970 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-72db1ead-39b0-4698-b11a-cc2b0fb5ec34 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for user b3da9d7af0fd4c1d99973e6b277b16d2 and project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:25:07.829806 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-72db1ead-39b0-4698-b11a-cc2b0fb5ec34 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.068253 Aug 31 00:25:07.831338 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 250/517] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 31 00:25:07 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:07.887664 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9a4c81d9-30b8-4a9a-bfc8-d0c098bbeca0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments/7cc7d608-159c-4843-8222-1e5d9eaaf833" status: 202 len: 0 microversion: 2.20 time: 0.249829 Aug 31 00:25:07.888861 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 268/518] 10.222.0.47 () {60 vars in 1457 bytes} [Wed Aug 31 00:25:07 2022] DELETE /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments/7cc7d608-159c-4843-8222-1e5d9eaaf833 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:25:07.900060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-63bb56e7-115a-40f9-9dc5-d5ed3efed029 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:07.902655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-63bb56e7-115a-40f9-9dc5-d5ed3efed029 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:07.910116 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63bb56e7-115a-40f9-9dc5-d5ed3efed029 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.910610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63bb56e7-115a-40f9-9dc5-d5ed3efed029 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.911216 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63bb56e7-115a-40f9-9dc5-d5ed3efed029 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.911941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63bb56e7-115a-40f9-9dc5-d5ed3efed029 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.912425 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63bb56e7-115a-40f9-9dc5-d5ed3efed029 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.912853 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63bb56e7-115a-40f9-9dc5-d5ed3efed029 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.947098 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-63bb56e7-115a-40f9-9dc5-d5ed3efed029 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051775 Aug 31 00:25:07.947813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 251/519] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 31 00:25:07 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:25:08.345318 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4d721ac9-05cd-4727-9894-5feb0ddeb1aa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:08.346255 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4d721ac9-05cd-4727-9894-5feb0ddeb1aa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:08.353800 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d721ac9-05cd-4727-9894-5feb0ddeb1aa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.354385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d721ac9-05cd-4727-9894-5feb0ddeb1aa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.354851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d721ac9-05cd-4727-9894-5feb0ddeb1aa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.355550 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d721ac9-05cd-4727-9894-5feb0ddeb1aa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.356181 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d721ac9-05cd-4727-9894-5feb0ddeb1aa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.356472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d721ac9-05cd-4727-9894-5feb0ddeb1aa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.561620 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4d721ac9-05cd-4727-9894-5feb0ddeb1aa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:08.573997 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4d721ac9-05cd-4727-9894-5feb0ddeb1aa tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1724 microversion: 2.1 time: 0.234237 Aug 31 00:25:08.574761 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 269/520] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:08 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:08.966626 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-26872fac-7eb9-4e44-9f8e-2569bfa81c2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:08.970773 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-26872fac-7eb9-4e44-9f8e-2569bfa81c2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:09.000650 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26872fac-7eb9-4e44-9f8e-2569bfa81c2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.002505 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26872fac-7eb9-4e44-9f8e-2569bfa81c2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.003251 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26872fac-7eb9-4e44-9f8e-2569bfa81c2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.004534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26872fac-7eb9-4e44-9f8e-2569bfa81c2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.005717 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26872fac-7eb9-4e44-9f8e-2569bfa81c2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.006594 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26872fac-7eb9-4e44-9f8e-2569bfa81c2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.067264 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-26872fac-7eb9-4e44-9f8e-2569bfa81c2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108969 Aug 31 00:25:09.068338 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 252/521] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 31 00:25:08 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:25:09.601330 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2eeeb985-7298-4717-9a9c-649f17d746c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:09.602128 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2eeeb985-7298-4717-9a9c-649f17d746c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:09.608768 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-120112191", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "923db031-4095-45ac-869f-da21aba3a797"}], "security_groups": [{"name": "tempest-securitygroup--1993890157"}], "key_name": "tempest-keypair-8222539", "user_data": "}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:09.610118 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2eeeb985-7298-4717-9a9c-649f17d746c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.610908 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2eeeb985-7298-4717-9a9c-649f17d746c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.611466 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2eeeb985-7298-4717-9a9c-649f17d746c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.612276 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2eeeb985-7298-4717-9a9c-649f17d746c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.612851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2eeeb985-7298-4717-9a9c-649f17d746c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.613326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2eeeb985-7298-4717-9a9c-649f17d746c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.812684 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] validate_networks() for [('923db031-4095-45ac-869f-da21aba3a797', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:25:09.819805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2eeeb985-7298-4717-9a9c-649f17d746c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:09.837486 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2eeeb985-7298-4717-9a9c-649f17d746c1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1730 microversion: 2.1 time: 0.240676 Aug 31 00:25:09.838553 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 270/522] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:09 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:09.877768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-843ff958-76cf-4058-8e62-1dfff51c963a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:09.879539 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-843ff958-76cf-4058-8e62-1dfff51c963a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:09.891603 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-843ff958-76cf-4058-8e62-1dfff51c963a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.892983 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-843ff958-76cf-4058-8e62-1dfff51c963a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.894039 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-843ff958-76cf-4058-8e62-1dfff51c963a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.895658 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-843ff958-76cf-4058-8e62-1dfff51c963a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.896912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-843ff958-76cf-4058-8e62-1dfff51c963a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.897696 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-843ff958-76cf-4058-8e62-1dfff51c963a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:10.086202 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-843ff958-76cf-4058-8e62-1dfff51c963a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.215938 Aug 31 00:25:10.086821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 271/523] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 31 00:25:09 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:25:10.092663 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0f2c404c-4b4a-4a49-ae36-9553ba03415a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:10.096990 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0f2c404c-4b4a-4a49-ae36-9553ba03415a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:10.103497 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0f2c404c-4b4a-4a49-ae36-9553ba03415a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:10.103887 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0f2c404c-4b4a-4a49-ae36-9553ba03415a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:10.104353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0f2c404c-4b4a-4a49-ae36-9553ba03415a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:10.105100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0f2c404c-4b4a-4a49-ae36-9553ba03415a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:10.105572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0f2c404c-4b4a-4a49-ae36-9553ba03415a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:10.106003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0f2c404c-4b4a-4a49-ae36-9553ba03415a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:10.144335 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0f2c404c-4b4a-4a49-ae36-9553ba03415a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056128 Aug 31 00:25:10.151981 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 272/524] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 31 00:25:10 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:25:10.519308 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:25:10.520124 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:25:10.520844 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:25:10.521541 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:25:10.522208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:25:10.538149 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:10.538678 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:10.539635 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:10.540725 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:10.541219 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:10.541649 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:10.561863 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:25:10.567367 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for user b3da9d7af0fd4c1d99973e6b277b16d2 and project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:25:10.582596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:25:10.585403 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:25:10.599655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:10.641566 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8beeb3da-f7c6-4d1d-a35b-4e50f19943ca tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.037126 Aug 31 00:25:10.642494 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 253/525] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:25:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:25:10.658803 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-44b061bc-d443-44a8-b567-b86887a631c1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:10.660100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-44b061bc-d443-44a8-b567-b86887a631c1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:10.752951 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-44b061bc-d443-44a8-b567-b86887a631c1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:10.767971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-44b061bc-d443-44a8-b567-b86887a631c1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1238 microversion: 2.1 time: 0.117080 Aug 31 00:25:10.769255 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 273/526] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:10 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1238 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:11.167632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f8823786-e652-4164-a796-d26d4fdc25b9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:11.175659 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f8823786-e652-4164-a796-d26d4fdc25b9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:11.192530 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f8823786-e652-4164-a796-d26d4fdc25b9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:11.194042 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f8823786-e652-4164-a796-d26d4fdc25b9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:11.194996 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f8823786-e652-4164-a796-d26d4fdc25b9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:11.196512 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f8823786-e652-4164-a796-d26d4fdc25b9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:11.197773 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f8823786-e652-4164-a796-d26d4fdc25b9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:11.199010 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f8823786-e652-4164-a796-d26d4fdc25b9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:11.284756 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f8823786-e652-4164-a796-d26d4fdc25b9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.126501 Aug 31 00:25:11.286850 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 254/527] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 31 00:25:11 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:25:11.451411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-c3b1eb95-9bf9-4057-a6c9-5cecd594ad19 req-38b30896-4909-4244-b65f-4dab824ae91c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e8d6e3-f38c-4d75-8f36-60f17fec87a4", "tag": "bb85f003-67c3-4300-9f2a-5e9218c74a03"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:11.483070 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c3b1eb95-9bf9-4057-a6c9-5cecd594ad19 req-38b30896-4909-4244-b65f-4dab824ae91c service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:11.484559 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c3b1eb95-9bf9-4057-a6c9-5cecd594ad19 req-38b30896-4909-4244-b65f-4dab824ae91c service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:11.485865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c3b1eb95-9bf9-4057-a6c9-5cecd594ad19 req-38b30896-4909-4244-b65f-4dab824ae91c service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:11.521846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-c3b1eb95-9bf9-4057-a6c9-5cecd594ad19 req-38b30896-4909-4244-b65f-4dab824ae91c service nova] Creating event network-changed:bb85f003-67c3-4300-9f2a-5e9218c74a03 for instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 on hv-cinder-85221 Aug 31 00:25:11.531214 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-c3b1eb95-9bf9-4057-a6c9-5cecd594ad19 req-38b30896-4909-4244-b65f-4dab824ae91c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086142 Aug 31 00:25:11.532881 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 274/528] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:25:11.798921 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f6770488-2b72-4f5f-b686-0b5be157842b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:11.799652 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f6770488-2b72-4f5f-b686-0b5be157842b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:11.807673 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6770488-2b72-4f5f-b686-0b5be157842b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:11.808734 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6770488-2b72-4f5f-b686-0b5be157842b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:11.809440 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6770488-2b72-4f5f-b686-0b5be157842b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:11.810387 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6770488-2b72-4f5f-b686-0b5be157842b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:11.811062 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6770488-2b72-4f5f-b686-0b5be157842b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:11.811700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f6770488-2b72-4f5f-b686-0b5be157842b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:12.021347 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f6770488-2b72-4f5f-b686-0b5be157842b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:12.039448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f6770488-2b72-4f5f-b686-0b5be157842b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1234 microversion: 2.1 time: 0.245428 Aug 31 00:25:12.040790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 255/529] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:11 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1234 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:12.302583 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-29168635-2a01-4e10-9355-383cf9bf8547 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:12.305389 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-29168635-2a01-4e10-9355-383cf9bf8547 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:12.319479 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29168635-2a01-4e10-9355-383cf9bf8547 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:12.319985 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29168635-2a01-4e10-9355-383cf9bf8547 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:12.324031 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29168635-2a01-4e10-9355-383cf9bf8547 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:12.326138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29168635-2a01-4e10-9355-383cf9bf8547 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:12.330159 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29168635-2a01-4e10-9355-383cf9bf8547 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:12.330634 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29168635-2a01-4e10-9355-383cf9bf8547 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:12.387325 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-29168635-2a01-4e10-9355-383cf9bf8547 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.089409 Aug 31 00:25:12.387928 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 275/530] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 31 00:25:12 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:12.480510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-60450c59-89a3-4920-b3f3-9130f070bbbb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:12.481220 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-60450c59-89a3-4920-b3f3-9130f070bbbb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:12.488781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-60450c59-89a3-4920-b3f3-9130f070bbbb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:12.489257 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-60450c59-89a3-4920-b3f3-9130f070bbbb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:12.489703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-60450c59-89a3-4920-b3f3-9130f070bbbb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:12.490456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-60450c59-89a3-4920-b3f3-9130f070bbbb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:12.490902 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-60450c59-89a3-4920-b3f3-9130f070bbbb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:12.491340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-60450c59-89a3-4920-b3f3-9130f070bbbb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:12.531972 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-60450c59-89a3-4920-b3f3-9130f070bbbb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:25:12.667231 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-60450c59-89a3-4920-b3f3-9130f070bbbb tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 204 len: 0 microversion: 2.20 time: 0.191113 Aug 31 00:25:12.668503 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 256/531] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 31 00:25:12 2022] DELETE /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 00:25:12.679074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:12.679880 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:12.689047 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:12.689681 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:12.690219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:12.691083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:12.691714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:12.692249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:12.882622 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:12.886050 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:12.897132 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:12.899914 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:12.901515 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a979350e-88e6-42b5-a7d1-028724e31674 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.226992 Aug 31 00:25:12.902311 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 276/532] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:12 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:13.080566 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-01f0ef1e-35ca-47f9-8259-d815671220fa tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:13.081665 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-01f0ef1e-35ca-47f9-8259-d815671220fa tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:13.090796 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01f0ef1e-35ca-47f9-8259-d815671220fa tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.091514 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01f0ef1e-35ca-47f9-8259-d815671220fa tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.092087 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01f0ef1e-35ca-47f9-8259-d815671220fa tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.093183 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01f0ef1e-35ca-47f9-8259-d815671220fa tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.094552 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01f0ef1e-35ca-47f9-8259-d815671220fa tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.095179 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01f0ef1e-35ca-47f9-8259-d815671220fa tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.182800 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-01f0ef1e-35ca-47f9-8259-d815671220fa tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:13.192032 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-01f0ef1e-35ca-47f9-8259-d815671220fa tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1290 microversion: 2.1 time: 0.118175 Aug 31 00:25:13.192732 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 257/533] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:13 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1290 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:13.549027 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-1dc4c936-1ca0-4c5b-b74c-af2cf81d907b req-784cec9f-c591-4d15-a6d1-f17b86a722f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e8d6e3-f38c-4d75-8f36-60f17fec87a4", "tag": "bb85f003-67c3-4300-9f2a-5e9218c74a03"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:13.560309 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-1dc4c936-1ca0-4c5b-b74c-af2cf81d907b req-784cec9f-c591-4d15-a6d1-f17b86a722f2 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.560796 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-1dc4c936-1ca0-4c5b-b74c-af2cf81d907b req-784cec9f-c591-4d15-a6d1-f17b86a722f2 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.561233 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-1dc4c936-1ca0-4c5b-b74c-af2cf81d907b req-784cec9f-c591-4d15-a6d1-f17b86a722f2 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.574385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-1dc4c936-1ca0-4c5b-b74c-af2cf81d907b req-784cec9f-c591-4d15-a6d1-f17b86a722f2 service nova] Creating event network-changed:bb85f003-67c3-4300-9f2a-5e9218c74a03 for instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 on hv-cinder-85221 Aug 31 00:25:13.581592 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-1dc4c936-1ca0-4c5b-b74c-af2cf81d907b req-784cec9f-c591-4d15-a6d1-f17b86a722f2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036887 Aug 31 00:25:13.582256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 277/534] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:25:13.942696 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:13.943314 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:13.950337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.950831 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.951268 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.952010 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.952574 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.953255 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:14.116309 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:14.126232 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:14.127782 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:14.129027 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-78846af2-bbe4-42b6-9c7c-4d8c917112ee tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.190766 Aug 31 00:25:14.129591 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 258/535] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:13 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:14.214346 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-eea1c03c-c37a-4556-9a07-0ab9143fd68c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:14.214931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-eea1c03c-c37a-4556-9a07-0ab9143fd68c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:14.222497 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eea1c03c-c37a-4556-9a07-0ab9143fd68c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:14.222991 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eea1c03c-c37a-4556-9a07-0ab9143fd68c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:14.223424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eea1c03c-c37a-4556-9a07-0ab9143fd68c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:14.224176 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eea1c03c-c37a-4556-9a07-0ab9143fd68c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:14.224637 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eea1c03c-c37a-4556-9a07-0ab9143fd68c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:14.225058 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-eea1c03c-c37a-4556-9a07-0ab9143fd68c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:14.294790 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-eea1c03c-c37a-4556-9a07-0ab9143fd68c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:14.304415 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-eea1c03c-c37a-4556-9a07-0ab9143fd68c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1290 microversion: 2.1 time: 0.094553 Aug 31 00:25:14.305023 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 278/536] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:14 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:15.154861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:15.155476 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:15.163217 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:15.163707 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:15.164138 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:15.164908 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:15.165356 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:15.165776 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:15.326970 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-adbbe319-da6d-4d92-ab0a-58fa64c15f64 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:15.328434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-adbbe319-da6d-4d92-ab0a-58fa64c15f64 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:15.337028 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adbbe319-da6d-4d92-ab0a-58fa64c15f64 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:15.337582 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adbbe319-da6d-4d92-ab0a-58fa64c15f64 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:15.338080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adbbe319-da6d-4d92-ab0a-58fa64c15f64 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:15.339060 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adbbe319-da6d-4d92-ab0a-58fa64c15f64 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:15.339619 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adbbe319-da6d-4d92-ab0a-58fa64c15f64 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:15.340278 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adbbe319-da6d-4d92-ab0a-58fa64c15f64 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:15.379513 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:15.389333 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:15.391425 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:15.392699 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1232c0d0-fbb7-40f1-83be-bebaf0947744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.242378 Aug 31 00:25:15.393266 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 259/537] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:15 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:15.433050 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-adbbe319-da6d-4d92-ab0a-58fa64c15f64 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:15.442425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-adbbe319-da6d-4d92-ab0a-58fa64c15f64 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1290 microversion: 2.1 time: 0.119883 Aug 31 00:25:15.443025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 279/538] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:15 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1290 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:16.430771 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:16.431967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:16.440052 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:16.440726 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:16.441287 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:16.442098 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:16.442605 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:16.443107 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:16.469876 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8b369e20-f399-4fe0-b820-9154b392c1d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:16.471041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8b369e20-f399-4fe0-b820-9154b392c1d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:16.482724 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b369e20-f399-4fe0-b820-9154b392c1d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:16.483597 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b369e20-f399-4fe0-b820-9154b392c1d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:16.485203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b369e20-f399-4fe0-b820-9154b392c1d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:16.486508 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b369e20-f399-4fe0-b820-9154b392c1d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:16.487337 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b369e20-f399-4fe0-b820-9154b392c1d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:16.488112 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8b369e20-f399-4fe0-b820-9154b392c1d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:16.596006 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8b369e20-f399-4fe0-b820-9154b392c1d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:16.606239 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8b369e20-f399-4fe0-b820-9154b392c1d2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1290 microversion: 2.1 time: 0.144392 Aug 31 00:25:16.607215 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 280/539] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:16 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1290 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:16.635307 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:16.645736 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:16.647447 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:16.648963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1c0d2e96-7390-4611-8f07-0b9766d642a1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.222748 Aug 31 00:25:16.649538 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 260/540] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:16 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:17.630463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-11db8699-fb70-4569-9042-8632a903d7d9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:17.631029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-11db8699-fb70-4569-9042-8632a903d7d9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:17.638271 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11db8699-fb70-4569-9042-8632a903d7d9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:17.638822 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11db8699-fb70-4569-9042-8632a903d7d9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:17.639301 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11db8699-fb70-4569-9042-8632a903d7d9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:17.640011 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11db8699-fb70-4569-9042-8632a903d7d9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:17.640535 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11db8699-fb70-4569-9042-8632a903d7d9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:17.640958 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11db8699-fb70-4569-9042-8632a903d7d9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:17.679151 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:17.680132 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:17.691740 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:17.692570 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:17.693253 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:17.694424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:17.695142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:17.695828 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:17.721041 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:17.744912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-11db8699-fb70-4569-9042-8632a903d7d9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:17.760700 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-11db8699-fb70-4569-9042-8632a903d7d9 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1290 microversion: 2.1 time: 0.133771 Aug 31 00:25:17.761735 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 281/541] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:17 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1290 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:17.855304 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:17.865454 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:17.866917 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:17.868105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-42ff3ad7-918b-4b31-9d10-c9ccc7a7c027 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.196765 Aug 31 00:25:17.868702 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 261/542] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:17 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:18.798383 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e5791cb0-c304-4074-96ac-869b982ccf81 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:18.798992 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e5791cb0-c304-4074-96ac-869b982ccf81 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:18.806399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5791cb0-c304-4074-96ac-869b982ccf81 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:18.806878 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5791cb0-c304-4074-96ac-869b982ccf81 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:18.807308 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5791cb0-c304-4074-96ac-869b982ccf81 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:18.808026 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5791cb0-c304-4074-96ac-869b982ccf81 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:18.808506 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5791cb0-c304-4074-96ac-869b982ccf81 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:18.808929 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e5791cb0-c304-4074-96ac-869b982ccf81 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:18.884777 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e5791cb0-c304-4074-96ac-869b982ccf81 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:18.893666 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:18.894472 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:18.894748 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e5791cb0-c304-4074-96ac-869b982ccf81 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1290 microversion: 2.1 time: 0.101672 Aug 31 00:25:18.895350 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 282/543] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:18 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:18.907599 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:18.908517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:18.909312 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:18.910636 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:18.911501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:18.912337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:19.105739 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:19.115665 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:19.117155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:19.118355 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b493ba2f-bea3-4bb0-96c9-850c18443d59 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.229875 Aug 31 00:25:19.118931 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 262/544] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:18 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:19.929686 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-cd2b9d85-0aef-4a93-ad4e-c8a3f8a23ed2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:19.930335 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-cd2b9d85-0aef-4a93-ad4e-c8a3f8a23ed2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:19.939036 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd2b9d85-0aef-4a93-ad4e-c8a3f8a23ed2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:19.939786 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd2b9d85-0aef-4a93-ad4e-c8a3f8a23ed2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:19.940673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd2b9d85-0aef-4a93-ad4e-c8a3f8a23ed2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:19.942022 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd2b9d85-0aef-4a93-ad4e-c8a3f8a23ed2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:19.942888 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd2b9d85-0aef-4a93-ad4e-c8a3f8a23ed2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:19.943689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd2b9d85-0aef-4a93-ad4e-c8a3f8a23ed2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:20.041168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-cd2b9d85-0aef-4a93-ad4e-c8a3f8a23ed2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:20.050872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-cd2b9d85-0aef-4a93-ad4e-c8a3f8a23ed2 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1290 microversion: 2.1 time: 0.125396 Aug 31 00:25:20.051481 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 283/545] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:19 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1290 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:20.142571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:20.143305 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:20.151309 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:20.151986 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:20.152576 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:20.153428 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:20.153947 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:20.154424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:20.319040 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:20.328247 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:20.330036 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:20.331457 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-06d531e6-ea9c-49d1-b79f-439c8ba3f0f2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.193978 Aug 31 00:25:20.332554 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 263/546] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:20 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:21.081997 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8a7260f4-bc24-4f16-98b4-3822d312b83f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:21.084293 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8a7260f4-bc24-4f16-98b4-3822d312b83f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:21.119539 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:21.138492 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a7260f4-bc24-4f16-98b4-3822d312b83f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:21.139804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a7260f4-bc24-4f16-98b4-3822d312b83f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:21.141135 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a7260f4-bc24-4f16-98b4-3822d312b83f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:21.143204 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a7260f4-bc24-4f16-98b4-3822d312b83f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:21.145010 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a7260f4-bc24-4f16-98b4-3822d312b83f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:21.146129 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8a7260f4-bc24-4f16-98b4-3822d312b83f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:21.318628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8a7260f4-bc24-4f16-98b4-3822d312b83f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:21.330175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8a7260f4-bc24-4f16-98b4-3822d312b83f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1308 microversion: 2.1 time: 0.260193 Aug 31 00:25:21.330978 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 284/547] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:21 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:21.357529 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:21.358460 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:21.361194 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:21.362961 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=10 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:21.372102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:21.372822 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:21.373532 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:21.375261 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:21.375979 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:21.376511 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:22.064896 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:22.076128 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:22.079601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:22.081935 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5c5768e5-bef2-462d-b523-86890a50964f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1722 microversion: 2.20 time: 0.729393 Aug 31 00:25:22.082788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 264/548] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:21 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1722 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:22.360112 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9b9b8765-4f92-4456-901c-242e8804d1c3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:22.360991 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9b9b8765-4f92-4456-901c-242e8804d1c3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:22.367882 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9b9b8765-4f92-4456-901c-242e8804d1c3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:22.368552 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9b9b8765-4f92-4456-901c-242e8804d1c3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:22.368951 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9b9b8765-4f92-4456-901c-242e8804d1c3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:22.369782 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9b9b8765-4f92-4456-901c-242e8804d1c3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:22.370240 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9b9b8765-4f92-4456-901c-242e8804d1c3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:22.370662 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9b9b8765-4f92-4456-901c-242e8804d1c3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:22.477599 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9b9b8765-4f92-4456-901c-242e8804d1c3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:22.492973 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9b9b8765-4f92-4456-901c-242e8804d1c3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1296 microversion: 2.1 time: 0.137718 Aug 31 00:25:22.494100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 285/549] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:22 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1296 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:23.110648 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:23.112329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:23.123929 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.125861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.126849 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.128385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.129393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.130061 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.327103 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:23.336484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:23.337957 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:23.339200 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8b48ae33-ff1c-4fef-94e5-db0588be8fdc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1655 microversion: 2.20 time: 0.233347 Aug 31 00:25:23.339856 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 265/550] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:23 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1655 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:23.517239 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-11ae39a1-c0f3-4a53-83fd-f76129e1434d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:23.517844 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-11ae39a1-c0f3-4a53-83fd-f76129e1434d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:23.526222 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11ae39a1-c0f3-4a53-83fd-f76129e1434d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.526721 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11ae39a1-c0f3-4a53-83fd-f76129e1434d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.527162 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11ae39a1-c0f3-4a53-83fd-f76129e1434d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.527904 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11ae39a1-c0f3-4a53-83fd-f76129e1434d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.528405 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11ae39a1-c0f3-4a53-83fd-f76129e1434d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.528832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11ae39a1-c0f3-4a53-83fd-f76129e1434d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.679848 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-11ae39a1-c0f3-4a53-83fd-f76129e1434d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:23.688854 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-11ae39a1-c0f3-4a53-83fd-f76129e1434d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1296 microversion: 2.1 time: 0.175804 Aug 31 00:25:23.689545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 286/551] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:23 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1296 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:23.961491 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-38599bc9-f228-490f-9bbb-01f695e301da req-2b6bf6c6-9fed-4f5d-a083-12be3b8f9b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a312d8-6cb2-4da8-a19b-215372294799", "name": "network-vif-deleted", "tag": "0ff0dbfa-0c17-4d1f-bc12-fdd58530b639"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:23.985479 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-38599bc9-f228-490f-9bbb-01f695e301da req-2b6bf6c6-9fed-4f5d-a083-12be3b8f9b2d service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.986539 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-38599bc9-f228-490f-9bbb-01f695e301da req-2b6bf6c6-9fed-4f5d-a083-12be3b8f9b2d service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.987189 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-38599bc9-f228-490f-9bbb-01f695e301da req-2b6bf6c6-9fed-4f5d-a083-12be3b8f9b2d service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.002421 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-29cc5273-1e7c-4534-a65c-481a8af3dcb5 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:24.003465 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-29cc5273-1e7c-4534-a65c-481a8af3dcb5 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:24.009356 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-38599bc9-f228-490f-9bbb-01f695e301da req-2b6bf6c6-9fed-4f5d-a083-12be3b8f9b2d service nova] Creating event network-vif-deleted:0ff0dbfa-0c17-4d1f-bc12-fdd58530b639 for instance e3a312d8-6cb2-4da8-a19b-215372294799 on hv-cinder-85221 Aug 31 00:25:24.017021 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-38599bc9-f228-490f-9bbb-01f695e301da req-2b6bf6c6-9fed-4f5d-a083-12be3b8f9b2d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061367 Aug 31 00:25:24.020224 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 266/552] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:24.022554 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29cc5273-1e7c-4534-a65c-481a8af3dcb5 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.023181 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29cc5273-1e7c-4534-a65c-481a8af3dcb5 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.024138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29cc5273-1e7c-4534-a65c-481a8af3dcb5 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.025070 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29cc5273-1e7c-4534-a65c-481a8af3dcb5 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.025857 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29cc5273-1e7c-4534-a65c-481a8af3dcb5 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.026597 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-29cc5273-1e7c-4534-a65c-481a8af3dcb5 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.304184 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-29cc5273-1e7c-4534-a65c-481a8af3dcb5 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lazy-loading 'services' on Instance uuid c5fa0677-75e7-4b3b-8813-37c81becbd7c {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:24.377448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:24.377448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:24.392759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.393258 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.393700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.394530 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.394853 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.401294 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.499713 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-29cc5273-1e7c-4534-a65c-481a8af3dcb5 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c/os-volume_attachments/224ce0b1-f374-4cc4-8681-1da150079c8d" status: 202 len: 0 microversion: 2.1 time: 0.517354 Aug 31 00:25:24.507992 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.508560 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.508997 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.509451 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lazy-loading 'fault' on Instance uuid e3a312d8-6cb2-4da8-a19b-215372294799 {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:24.513259 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 287/553] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:25:23 2022] DELETE /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c/os-volume_attachments/224ce0b1-f374-4cc4-8681-1da150079c8d => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:25:24.638445 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:24.669783 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:24.673224 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:24.675214 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-df01afb6-5c66-49a9-a33d-06ca5f1f62bd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1371 microversion: 2.20 time: 0.312443 Aug 31 00:25:24.676145 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 267/554] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:24 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:24.723152 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-55997ef2-6fb3-442a-8b8f-8095277630a7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:24.728183 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-55997ef2-6fb3-442a-8b8f-8095277630a7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:24.745361 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-55997ef2-6fb3-442a-8b8f-8095277630a7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.747423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-55997ef2-6fb3-442a-8b8f-8095277630a7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.749626 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-55997ef2-6fb3-442a-8b8f-8095277630a7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.752108 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-55997ef2-6fb3-442a-8b8f-8095277630a7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.756716 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-55997ef2-6fb3-442a-8b8f-8095277630a7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.757547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-55997ef2-6fb3-442a-8b8f-8095277630a7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.134919 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-55997ef2-6fb3-442a-8b8f-8095277630a7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:25.152731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-55997ef2-6fb3-442a-8b8f-8095277630a7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1364 microversion: 2.1 time: 0.443105 Aug 31 00:25:25.154366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 288/555] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:24 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1364 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:25.728832 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:25.729774 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:25.738719 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:25.739665 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:25.740478 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.741819 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:25.742629 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:25.743390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.804194 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:25.804963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:25.805646 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.806274 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lazy-loading 'fault' on Instance uuid e3a312d8-6cb2-4da8-a19b-215372294799 {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:25.879164 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:25.895378 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:25.899141 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:25.901517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c3539875-223a-4332-8cc5-72a0af3db475 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 200 len: 1371 microversion: 2.20 time: 0.176157 Aug 31 00:25:25.902563 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 268/556] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:25 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:26.043427 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-3e2b4fd8-feea-4215-9fab-0b503bcad3d1 req-d20efccd-88db-4f77-93e7-f9058ac4c30b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "599f96bf-1137-4129-af25-5d61b32a4349", "tag": "e3547217-2be7-4db4-b82d-59dc6f1654fc"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:26.054923 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3e2b4fd8-feea-4215-9fab-0b503bcad3d1 req-d20efccd-88db-4f77-93e7-f9058ac4c30b service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.055655 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3e2b4fd8-feea-4215-9fab-0b503bcad3d1 req-d20efccd-88db-4f77-93e7-f9058ac4c30b service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.056553 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3e2b4fd8-feea-4215-9fab-0b503bcad3d1 req-d20efccd-88db-4f77-93e7-f9058ac4c30b service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:26.087012 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-3e2b4fd8-feea-4215-9fab-0b503bcad3d1 req-d20efccd-88db-4f77-93e7-f9058ac4c30b service nova] Creating event network-changed:e3547217-2be7-4db4-b82d-59dc6f1654fc for instance 599f96bf-1137-4129-af25-5d61b32a4349 on hv-cinder-85221 Aug 31 00:25:26.096873 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-3e2b4fd8-feea-4215-9fab-0b503bcad3d1 req-d20efccd-88db-4f77-93e7-f9058ac4c30b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056241 Aug 31 00:25:26.109525 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 289/557] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:26.190466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ad65cf5f-4a96-4fdc-af1f-aaeddf104e52 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:26.191191 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ad65cf5f-4a96-4fdc-af1f-aaeddf104e52 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:26.198455 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad65cf5f-4a96-4fdc-af1f-aaeddf104e52 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.199336 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad65cf5f-4a96-4fdc-af1f-aaeddf104e52 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.199784 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad65cf5f-4a96-4fdc-af1f-aaeddf104e52 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:26.200692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad65cf5f-4a96-4fdc-af1f-aaeddf104e52 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.201152 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad65cf5f-4a96-4fdc-af1f-aaeddf104e52 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.201581 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ad65cf5f-4a96-4fdc-af1f-aaeddf104e52 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:26.870980 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ad65cf5f-4a96-4fdc-af1f-aaeddf104e52 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:26.886911 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ad65cf5f-4a96-4fdc-af1f-aaeddf104e52 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1364 microversion: 2.1 time: 0.701208 Aug 31 00:25:26.887979 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 269/558] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:26 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1364 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:26.941430 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:26.942911 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:26.950988 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.951827 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.953217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:26.954506 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.955272 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.955931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:26.974722 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] HTTP exception thrown: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Request method failure captured: Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 HTTP/1.1 Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlN9q7z7viVpTDrCziXrueDBfp2zIreU5Mi0KRdhR70wVGfMol1XmEB1_TCk5V4D51BjqZDl-T5o07DhI6h4yqdYIfgF3f0ulAoHz6nUujV97cUWzRjZWAtped83SO-w9CvIaSIpVO32tt9lfqj90idLLV-zC2LMExeHTIDW2bMEkE Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:25:26.976752 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e53c8a6e81fe48d5b9609b921283e64d"}]}] Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 08fa033114244fc89c82939202f911e7 Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:25:26.979746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'e3a312d8-6cb2-4da8-a19b-215372294799'} Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:25:26.986160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:25:26.987875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:25:26.989253 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Returning 404 to user: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:25:26.989253 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-dc1f15f8-7ba2-48b7-b382-567dc6483fa1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 404 len: 111 microversion: 2.20 time: 0.043702 Aug 31 00:25:26.989253 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 290/559] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:26 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:25:26.994514 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-50cf788b-935a-4c01-bd97-431b04453e81 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '.version_select at 0x7f1a3a8edd30>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:27.043542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-50cf788b-935a-4c01-bd97-431b04453e81 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067739810" status: 204 len: 0 microversion: 2.20 time: 0.052725 Aug 31 00:25:27.044332 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 270/560] 10.222.0.47 () {60 vars in 1262 bytes} [Wed Aug 31 00:25:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067739810 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 00:25:27.158168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9607a16a-e79a-4b11-8b76-3ac4bae53d88 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:27.158168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9607a16a-e79a-4b11-8b76-3ac4bae53d88 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:27.164562 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9607a16a-e79a-4b11-8b76-3ac4bae53d88 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:27.165042 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9607a16a-e79a-4b11-8b76-3ac4bae53d88 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:27.166570 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9607a16a-e79a-4b11-8b76-3ac4bae53d88 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:27.167325 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9607a16a-e79a-4b11-8b76-3ac4bae53d88 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:27.167794 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9607a16a-e79a-4b11-8b76-3ac4bae53d88 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:27.168253 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9607a16a-e79a-4b11-8b76-3ac4bae53d88 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:27.210836 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9607a16a-e79a-4b11-8b76-3ac4bae53d88 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Going to try to terminate instance {{(pid=127118) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:25:27.330922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9607a16a-e79a-4b11-8b76-3ac4bae53d88 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 204 len: 0 microversion: 2.1 time: 0.178396 Aug 31 00:25:27.331951 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 291/561] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:25:27 2022] DELETE /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:25:27.349539 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-588038a0-8ef8-45c8-8983-62171d8b68dc tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:27.350654 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-588038a0-8ef8-45c8-8983-62171d8b68dc tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:27.360894 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-588038a0-8ef8-45c8-8983-62171d8b68dc tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:27.361597 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-588038a0-8ef8-45c8-8983-62171d8b68dc tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:27.362358 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-588038a0-8ef8-45c8-8983-62171d8b68dc tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:27.363576 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-588038a0-8ef8-45c8-8983-62171d8b68dc tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:27.364286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-588038a0-8ef8-45c8-8983-62171d8b68dc tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:27.365732 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-588038a0-8ef8-45c8-8983-62171d8b68dc tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:27.634608 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-588038a0-8ef8-45c8-8983-62171d8b68dc tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:27.646673 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-588038a0-8ef8-45c8-8983-62171d8b68dc tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1511 microversion: 2.1 time: 0.308023 Aug 31 00:25:27.647285 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 271/562] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:27 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:27.929119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c90cb8d9-8070-41c9-8ceb-67a700767fa5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:27.930626 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c90cb8d9-8070-41c9-8ceb-67a700767fa5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:27.942405 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c90cb8d9-8070-41c9-8ceb-67a700767fa5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:27.943402 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c90cb8d9-8070-41c9-8ceb-67a700767fa5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:27.944326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c90cb8d9-8070-41c9-8ceb-67a700767fa5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:27.945719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c90cb8d9-8070-41c9-8ceb-67a700767fa5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:27.946677 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c90cb8d9-8070-41c9-8ceb-67a700767fa5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:27.947557 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c90cb8d9-8070-41c9-8ceb-67a700767fa5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.080446 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9b4e2081-2345-4886-a935-ca42f1387705 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Action: 'create', calling method: .version_select at 0x7f1a3a992310>, body: {"keypair": {"name": "tempest-keypair-1905310872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8AapPRknOCdOE16xmVK9xUNvhJlThXDgSxMU52r0mF6CFJBfQAUvT3D0yX770ZziZXSpXXp//twXOPJmzBLV+onxB2gDzwjEj+F4rO+SskFqHcdrDaxua7U8JRBJNmxQ=="}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:28.114536 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-9b4e2081-2345-4886-a935-ca42f1387705 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Getting quotas for project e53c8a6e81fe48d5b9609b921283e64d. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:25:28.119618 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-9b4e2081-2345-4886-a935-ca42f1387705 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Getting quotas for user 08fa033114244fc89c82939202f911e7 and project e53c8a6e81fe48d5b9609b921283e64d. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:25:28.148890 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9b4e2081-2345-4886-a935-ca42f1387705 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.072184 Aug 31 00:25:28.149783 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 272/563] 10.222.0.47 () {62 vars in 1200 bytes} [Wed Aug 31 00:25:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 00:25:28.205931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c90cb8d9-8070-41c9-8ceb-67a700767fa5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:28.214771 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c90cb8d9-8070-41c9-8ceb-67a700767fa5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1364 microversion: 2.1 time: 0.294527 Aug 31 00:25:28.215492 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 292/564] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:27 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:28.671133 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c4a5e9e9-b09e-4556-9d6f-94210c0dbc08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:28.672115 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c4a5e9e9-b09e-4556-9d6f-94210c0dbc08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:28.681098 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4a5e9e9-b09e-4556-9d6f-94210c0dbc08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:28.681906 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4a5e9e9-b09e-4556-9d6f-94210c0dbc08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:28.682402 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4a5e9e9-b09e-4556-9d6f-94210c0dbc08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.683168 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4a5e9e9-b09e-4556-9d6f-94210c0dbc08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:28.683748 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4a5e9e9-b09e-4556-9d6f-94210c0dbc08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:28.684280 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c4a5e9e9-b09e-4556-9d6f-94210c0dbc08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.959978 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c4a5e9e9-b09e-4556-9d6f-94210c0dbc08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:28.970901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c4a5e9e9-b09e-4556-9d6f-94210c0dbc08 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1511 microversion: 2.1 time: 0.306219 Aug 31 00:25:28.971638 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 273/565] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:28 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:29.251822 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-515a1968-fee8-4f8e-a6dc-9f95f968cdd5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:29.253457 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-515a1968-fee8-4f8e-a6dc-9f95f968cdd5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:29.261335 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-515a1968-fee8-4f8e-a6dc-9f95f968cdd5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:29.261827 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-515a1968-fee8-4f8e-a6dc-9f95f968cdd5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:29.262265 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-515a1968-fee8-4f8e-a6dc-9f95f968cdd5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:29.263052 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-515a1968-fee8-4f8e-a6dc-9f95f968cdd5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:29.263746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-515a1968-fee8-4f8e-a6dc-9f95f968cdd5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:29.264194 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-515a1968-fee8-4f8e-a6dc-9f95f968cdd5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:29.268416 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:29.543384 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-515a1968-fee8-4f8e-a6dc-9f95f968cdd5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:29.554849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-515a1968-fee8-4f8e-a6dc-9f95f968cdd5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1364 microversion: 2.1 time: 0.308281 Aug 31 00:25:29.555755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 293/566] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:29 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1364 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:30.008869 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9b0cb28e-9bc4-4a96-a416-6a1fbbef19f2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:30.009891 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9b0cb28e-9bc4-4a96-a416-6a1fbbef19f2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:30.021595 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9b0cb28e-9bc4-4a96-a416-6a1fbbef19f2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:30.022402 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9b0cb28e-9bc4-4a96-a416-6a1fbbef19f2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:30.023060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9b0cb28e-9bc4-4a96-a416-6a1fbbef19f2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:30.024583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9b0cb28e-9bc4-4a96-a416-6a1fbbef19f2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:30.025365 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9b0cb28e-9bc4-4a96-a416-6a1fbbef19f2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:30.026066 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9b0cb28e-9bc4-4a96-a416-6a1fbbef19f2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:30.252783 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9b0cb28e-9bc4-4a96-a416-6a1fbbef19f2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:30.257490 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1806080081", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b7c3317-0ec5-4bcb-bb71-0099edaec3ef"}], "security_groups": [{"name": "tempest-securitygroup--1977210240"}], "key_name": "tempest-keypair-1905310872", "user_data": "}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:30.267455 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9b0cb28e-9bc4-4a96-a416-6a1fbbef19f2 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1511 microversion: 2.1 time: 0.264573 Aug 31 00:25:30.268613 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 274/567] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:30 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:30.456621 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.network.neutron [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] validate_networks() for [('6b7c3317-0ec5-4bcb-bb71-0099edaec3ef', None, None, None, None, None)] {{(pid=127118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:25:30.580066 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-40a5c305-b5f4-42a6-8eaf-f5f667ad3b17 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:30.581122 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-40a5c305-b5f4-42a6-8eaf-f5f667ad3b17 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:30.592426 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-40a5c305-b5f4-42a6-8eaf-f5f667ad3b17 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:30.598421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-40a5c305-b5f4-42a6-8eaf-f5f667ad3b17 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:30.599148 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-40a5c305-b5f4-42a6-8eaf-f5f667ad3b17 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:30.600135 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-40a5c305-b5f4-42a6-8eaf-f5f667ad3b17 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:30.600837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-40a5c305-b5f4-42a6-8eaf-f5f667ad3b17 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:30.601444 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-40a5c305-b5f4-42a6-8eaf-f5f667ad3b17 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:31.179471 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-40a5c305-b5f4-42a6-8eaf-f5f667ad3b17 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:31.200614 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-40a5c305-b5f4-42a6-8eaf-f5f667ad3b17 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1364 microversion: 2.1 time: 0.624758 Aug 31 00:25:31.201840 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 275/568] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:30 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1364 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:31.212328 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ff2a986a-4867-49ca-bd87-b5f5d06cef74 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:31.219686 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ff2a986a-4867-49ca-bd87-b5f5d06cef74 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:31.231207 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff2a986a-4867-49ca-bd87-b5f5d06cef74 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:31.231910 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff2a986a-4867-49ca-bd87-b5f5d06cef74 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:31.232585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff2a986a-4867-49ca-bd87-b5f5d06cef74 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:31.234343 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff2a986a-4867-49ca-bd87-b5f5d06cef74 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:31.235313 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff2a986a-4867-49ca-bd87-b5f5d06cef74 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:31.235956 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ff2a986a-4867-49ca-bd87-b5f5d06cef74 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:31.271778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ff2a986a-4867-49ca-bd87-b5f5d06cef74 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068252 Aug 31 00:25:31.272718 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 276/569] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:25:31 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:25:31.304563 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-43e58336-d1d4-45f7-8423-256d5884be8e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:31.305191 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-43e58336-d1d4-45f7-8423-256d5884be8e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:31.312017 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43e58336-d1d4-45f7-8423-256d5884be8e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:31.312606 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43e58336-d1d4-45f7-8423-256d5884be8e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:31.313348 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43e58336-d1d4-45f7-8423-256d5884be8e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:31.314110 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43e58336-d1d4-45f7-8423-256d5884be8e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:31.314653 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43e58336-d1d4-45f7-8423-256d5884be8e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:31.315018 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43e58336-d1d4-45f7-8423-256d5884be8e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:31.964822 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-43e58336-d1d4-45f7-8423-256d5884be8e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:31.982527 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-43e58336-d1d4-45f7-8423-256d5884be8e tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1511 microversion: 2.1 time: 0.681320 Aug 31 00:25:31.984620 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 277/570] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:31 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1511 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:31.998285 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-29542e78-b3ec-4a6f-ac74-44630d9020ea tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:32.000091 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-29542e78-b3ec-4a6f-ac74-44630d9020ea tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:32.018714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29542e78-b3ec-4a6f-ac74-44630d9020ea tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.019561 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29542e78-b3ec-4a6f-ac74-44630d9020ea tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.020366 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29542e78-b3ec-4a6f-ac74-44630d9020ea tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.021630 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29542e78-b3ec-4a6f-ac74-44630d9020ea tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.022483 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29542e78-b3ec-4a6f-ac74-44630d9020ea tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.023679 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-29542e78-b3ec-4a6f-ac74-44630d9020ea tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.036689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Flavor limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:25:32.038801 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Image limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:25:32.040947 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Flavor pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:25:32.042135 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Image pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:25:32.044304 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:25:32.066269 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.067873 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.069178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.070985 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.073153 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.074290 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.080172 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-29542e78-b3ec-4a6f-ac74-44630d9020ea tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:25:32.118281 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Getting quotas for project e53c8a6e81fe48d5b9609b921283e64d. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:25:32.127983 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Getting quotas for user 08fa033114244fc89c82939202f911e7 and project e53c8a6e81fe48d5b9609b921283e64d. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:25:32.149244 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:32.158261 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Going to run 1 instances... {{(pid=127118) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:25:32.164086 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:25:32.219851 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-29542e78-b3ec-4a6f-ac74-44630d9020ea tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 204 len: 0 microversion: 2.1 time: 0.233253 Aug 31 00:25:32.220503 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 278/571] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:25:31 2022] DELETE /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:25:32.233130 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4bc5b0e7-b57b-43d1-bab8-0f0f26449b32 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:32.233822 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4bc5b0e7-b57b-43d1-bab8-0f0f26449b32 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:32.240884 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4bc5b0e7-b57b-43d1-bab8-0f0f26449b32 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.241459 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4bc5b0e7-b57b-43d1-bab8-0f0f26449b32 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.241900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4bc5b0e7-b57b-43d1-bab8-0f0f26449b32 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.244311 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4bc5b0e7-b57b-43d1-bab8-0f0f26449b32 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.244901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4bc5b0e7-b57b-43d1-bab8-0f0f26449b32 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.245578 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4bc5b0e7-b57b-43d1-bab8-0f0f26449b32 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.295129 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5ee762d2-f157-4628-9416-6ae54247cd05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.243508 Aug 31 00:25:32.297058 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 294/572] 10.222.0.47 () {62 vars in 1188 bytes} [Wed Aug 31 00:25:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 00:25:32.307259 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-33e7c6f7-d3bc-4cb3-9f91-60a34e926b1f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:32.307964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-33e7c6f7-d3bc-4cb3-9f91-60a34e926b1f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:32.315812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-33e7c6f7-d3bc-4cb3-9f91-60a34e926b1f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.316365 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-33e7c6f7-d3bc-4cb3-9f91-60a34e926b1f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.316809 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-33e7c6f7-d3bc-4cb3-9f91-60a34e926b1f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.318835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-33e7c6f7-d3bc-4cb3-9f91-60a34e926b1f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.318835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-33e7c6f7-d3bc-4cb3-9f91-60a34e926b1f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.318835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-33e7c6f7-d3bc-4cb3-9f91-60a34e926b1f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.503710 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4bc5b0e7-b57b-43d1-bab8-0f0f26449b32 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:32.517493 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4bc5b0e7-b57b-43d1-bab8-0f0f26449b32 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1671 microversion: 2.1 time: 0.289476 Aug 31 00:25:32.532466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 279/573] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:32 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1671 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:32.532466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-f78b0bae-da1e-49c7-960b-ce900b265a98 req-ff82e579-12c0-4e41-865a-e05ed551cf91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5fa0677-75e7-4b3b-8813-37c81becbd7c", "name": "network-vif-deleted", "tag": "a907ffdd-5539-4622-af52-d1af362cf940"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:32.535523 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f78b0bae-da1e-49c7-960b-ce900b265a98 req-ff82e579-12c0-4e41-865a-e05ed551cf91 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.536449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f78b0bae-da1e-49c7-960b-ce900b265a98 req-ff82e579-12c0-4e41-865a-e05ed551cf91 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.537067 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f78b0bae-da1e-49c7-960b-ce900b265a98 req-ff82e579-12c0-4e41-865a-e05ed551cf91 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.556457 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-f78b0bae-da1e-49c7-960b-ce900b265a98 req-ff82e579-12c0-4e41-865a-e05ed551cf91 service nova] Creating event network-vif-deleted:a907ffdd-5539-4622-af52-d1af362cf940 for instance c5fa0677-75e7-4b3b-8813-37c81becbd7c on hv-cinder-85221 Aug 31 00:25:32.562058 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-f78b0bae-da1e-49c7-960b-ce900b265a98 req-ff82e579-12c0-4e41-865a-e05ed551cf91 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042126 Aug 31 00:25:32.562685 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 280/574] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:32.568753 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6ed6216d-916a-4638-96d5-ce1aa4df1c2f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:32.570397 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6ed6216d-916a-4638-96d5-ce1aa4df1c2f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:32.703754 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6ed6216d-916a-4638-96d5-ce1aa4df1c2f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:32.719783 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6ed6216d-916a-4638-96d5-ce1aa4df1c2f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:32.723766 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6ed6216d-916a-4638-96d5-ce1aa4df1c2f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:32.727024 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6ed6216d-916a-4638-96d5-ce1aa4df1c2f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1282 microversion: 2.20 time: 0.162564 Aug 31 00:25:32.729250 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 281/575] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:32 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:32.747077 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-e64f8e72-f4a2-4106-829d-e5ef8ce8be57 req-36773997-6a20-455a-ba4b-88986e9d8019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599f96bf-1137-4129-af25-5d61b32a4349", "name": "network-vif-plugged", "status": "completed", "tag": "e3547217-2be7-4db4-b82d-59dc6f1654fc"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:32.759350 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-33e7c6f7-d3bc-4cb3-9f91-60a34e926b1f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:32.767662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e64f8e72-f4a2-4106-829d-e5ef8ce8be57 req-36773997-6a20-455a-ba4b-88986e9d8019 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.768794 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e64f8e72-f4a2-4106-829d-e5ef8ce8be57 req-36773997-6a20-455a-ba4b-88986e9d8019 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.769977 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e64f8e72-f4a2-4106-829d-e5ef8ce8be57 req-36773997-6a20-455a-ba4b-88986e9d8019 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.776762 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-33e7c6f7-d3bc-4cb3-9f91-60a34e926b1f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1364 microversion: 2.1 time: 0.477744 Aug 31 00:25:32.777370 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 295/576] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:32 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1364 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:32.799047 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-e64f8e72-f4a2-4106-829d-e5ef8ce8be57 req-36773997-6a20-455a-ba4b-88986e9d8019 service nova] Creating event network-vif-plugged:e3547217-2be7-4db4-b82d-59dc6f1654fc for instance 599f96bf-1137-4129-af25-5d61b32a4349 on hv-cinder-85221 Aug 31 00:25:32.809507 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-e64f8e72-f4a2-4106-829d-e5ef8ce8be57 req-36773997-6a20-455a-ba4b-88986e9d8019 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075616 Aug 31 00:25:32.811012 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 282/577] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:33.007217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e6ede234-e1e0-4040-8ef9-b010c5430a30 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:33.007759 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e6ede234-e1e0-4040-8ef9-b010c5430a30 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:33.014224 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6ede234-e1e0-4040-8ef9-b010c5430a30 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.014724 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6ede234-e1e0-4040-8ef9-b010c5430a30 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.015941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6ede234-e1e0-4040-8ef9-b010c5430a30 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.016745 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6ede234-e1e0-4040-8ef9-b010c5430a30 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.017208 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6ede234-e1e0-4040-8ef9-b010c5430a30 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.017634 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6ede234-e1e0-4040-8ef9-b010c5430a30 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.092455 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e6ede234-e1e0-4040-8ef9-b010c5430a30 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.107671 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e6ede234-e1e0-4040-8ef9-b010c5430a30 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1469 microversion: 2.1 time: 0.104858 Aug 31 00:25:33.108979 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 296/578] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:33 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1469 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:33.558275 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d038415e-3186-42a3-a81a-00b389b8dddd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:33.559104 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d038415e-3186-42a3-a81a-00b389b8dddd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:33.565862 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d038415e-3186-42a3-a81a-00b389b8dddd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.566361 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d038415e-3186-42a3-a81a-00b389b8dddd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.566794 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d038415e-3186-42a3-a81a-00b389b8dddd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.567511 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d038415e-3186-42a3-a81a-00b389b8dddd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.567966 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d038415e-3186-42a3-a81a-00b389b8dddd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.568488 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d038415e-3186-42a3-a81a-00b389b8dddd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.729774 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d038415e-3186-42a3-a81a-00b389b8dddd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.739935 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d038415e-3186-42a3-a81a-00b389b8dddd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1671 microversion: 2.1 time: 0.186670 Aug 31 00:25:33.740609 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 283/579] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:33 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1671 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:33.751508 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:33.752129 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:33.754647 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:33.760912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.761636 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.762075 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.762797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.763284 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.763708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.800813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-197a03fe-279d-48d6-b6b1-9ec620f5423f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:33.801429 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-197a03fe-279d-48d6-b6b1-9ec620f5423f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:33.808927 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-197a03fe-279d-48d6-b6b1-9ec620f5423f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.809403 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-197a03fe-279d-48d6-b6b1-9ec620f5423f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.809855 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-197a03fe-279d-48d6-b6b1-9ec620f5423f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.810756 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-197a03fe-279d-48d6-b6b1-9ec620f5423f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.811265 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-197a03fe-279d-48d6-b6b1-9ec620f5423f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.811847 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-197a03fe-279d-48d6-b6b1-9ec620f5423f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.859818 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.869745 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.871501 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.872906 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-92f9858e-5035-4d65-a2e1-71e6d9a80b05 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1286 microversion: 2.20 time: 0.125834 Aug 31 00:25:33.873641 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 297/580] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:33 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:33.998674 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-197a03fe-279d-48d6-b6b1-9ec620f5423f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:34.008240 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-197a03fe-279d-48d6-b6b1-9ec620f5423f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1364 microversion: 2.1 time: 0.212947 Aug 31 00:25:34.008838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 284/581] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:33 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:34.142333 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d2b669d9-8fa7-487d-a255-fd6a3fa0905c tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:34.143237 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d2b669d9-8fa7-487d-a255-fd6a3fa0905c tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:34.151002 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d2b669d9-8fa7-487d-a255-fd6a3fa0905c tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.151511 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d2b669d9-8fa7-487d-a255-fd6a3fa0905c tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.151954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d2b669d9-8fa7-487d-a255-fd6a3fa0905c tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.152711 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d2b669d9-8fa7-487d-a255-fd6a3fa0905c tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.153169 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d2b669d9-8fa7-487d-a255-fd6a3fa0905c tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.153591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d2b669d9-8fa7-487d-a255-fd6a3fa0905c tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.247656 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d2b669d9-8fa7-487d-a255-fd6a3fa0905c tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:34.258119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d2b669d9-8fa7-487d-a255-fd6a3fa0905c tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1469 microversion: 2.1 time: 0.120103 Aug 31 00:25:34.258903 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 298/582] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:34 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1469 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:34.777115 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d78f69bf-48d2-409c-82ce-d29c021e01f7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:34.777737 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d78f69bf-48d2-409c-82ce-d29c021e01f7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:34.786193 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d78f69bf-48d2-409c-82ce-d29c021e01f7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.786614 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d78f69bf-48d2-409c-82ce-d29c021e01f7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.787247 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d78f69bf-48d2-409c-82ce-d29c021e01f7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.788050 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d78f69bf-48d2-409c-82ce-d29c021e01f7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.788553 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d78f69bf-48d2-409c-82ce-d29c021e01f7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.788986 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d78f69bf-48d2-409c-82ce-d29c021e01f7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.902130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:34.903406 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:34.915708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.916618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.917393 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.918889 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.920112 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.921739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:35.098242 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.115673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.117992 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.119310 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0aa2be7a-138c-4ff8-9819-82efb4c9fc25 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1278 microversion: 2.20 time: 0.226230 Aug 31 00:25:35.120483 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 299/583] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:34 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:35.126682 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-81876681-6be7-41ca-9374-34c5b0137b5d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:35.127637 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-81876681-6be7-41ca-9374-34c5b0137b5d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:35.135154 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81876681-6be7-41ca-9374-34c5b0137b5d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:35.135892 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81876681-6be7-41ca-9374-34c5b0137b5d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:35.136546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81876681-6be7-41ca-9374-34c5b0137b5d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:35.137472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81876681-6be7-41ca-9374-34c5b0137b5d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:35.138152 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81876681-6be7-41ca-9374-34c5b0137b5d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:35.138753 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81876681-6be7-41ca-9374-34c5b0137b5d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:35.436335 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d78f69bf-48d2-409c-82ce-d29c021e01f7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.446213 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d78f69bf-48d2-409c-82ce-d29c021e01f7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1671 microversion: 2.1 time: 0.673319 Aug 31 00:25:35.446939 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 285/584] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:34 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1671 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:35.452728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:35.453584 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:35.465684 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:35.465981 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:35.466314 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:35.467289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:35.468113 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:35.468630 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:35.504138 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:35.510174 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:35.510668 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:35.511116 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:35.511574 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lazy-loading 'fault' on Instance uuid c5fa0677-75e7-4b3b-8813-37c81becbd7c {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:35.619428 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dd5782e5f84ed68282cdda78ce909f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f449e37cc6482eaca34671c7541c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.630102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e9813cc7-7544-4858-a2b3-319000c344e9 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 200 len: 1307 microversion: 2.1 time: 0.181953 Aug 31 00:25:35.630815 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 286/585] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:35 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 1307 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:35.670633 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-81876681-6be7-41ca-9374-34c5b0137b5d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.680937 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-81876681-6be7-41ca-9374-34c5b0137b5d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1364 microversion: 2.1 time: 0.558911 Aug 31 00:25:35.681744 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 300/586] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:35 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1364 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:36.164062 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:36.164970 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:36.173167 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.173821 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.174654 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.175523 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.176081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.176765 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.281341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:36.291033 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:36.292592 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:36.293844 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-87429e78-a829-4ee6-9edc-89b04b022d55 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1334 microversion: 2.20 time: 0.134164 Aug 31 00:25:36.294414 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 287/587] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:36 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1334 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:36.487342 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-80d1027f-3639-46cc-87c5-816eb213dff8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:36.501480 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-80d1027f-3639-46cc-87c5-816eb213dff8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:36.540747 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80d1027f-3639-46cc-87c5-816eb213dff8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.542698 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80d1027f-3639-46cc-87c5-816eb213dff8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.543901 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80d1027f-3639-46cc-87c5-816eb213dff8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.545473 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80d1027f-3639-46cc-87c5-816eb213dff8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.547165 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80d1027f-3639-46cc-87c5-816eb213dff8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.549223 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80d1027f-3639-46cc-87c5-816eb213dff8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.613064 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-577780a4-1d20-4c9a-8f4e-2bccf2b7c177 req-8c3734e2-b04e-44a4-9d73-298362a7507a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e22ddf8-4065-4933-a8db-68b53f82a42e", "name": "network-vif-deleted", "tag": "6317fbd6-92fd-41d8-a8a9-21faad23ff44"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:36.629640 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-577780a4-1d20-4c9a-8f4e-2bccf2b7c177 req-8c3734e2-b04e-44a4-9d73-298362a7507a service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.630272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-577780a4-1d20-4c9a-8f4e-2bccf2b7c177 req-8c3734e2-b04e-44a4-9d73-298362a7507a service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.630907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-577780a4-1d20-4c9a-8f4e-2bccf2b7c177 req-8c3734e2-b04e-44a4-9d73-298362a7507a service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.646948 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-577780a4-1d20-4c9a-8f4e-2bccf2b7c177 req-8c3734e2-b04e-44a4-9d73-298362a7507a service nova] Creating event network-vif-deleted:6317fbd6-92fd-41d8-a8a9-21faad23ff44 for instance 1e22ddf8-4065-4933-a8db-68b53f82a42e on hv-cinder-85221 Aug 31 00:25:36.659551 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-577780a4-1d20-4c9a-8f4e-2bccf2b7c177 req-8c3734e2-b04e-44a4-9d73-298362a7507a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050965 Aug 31 00:25:36.664855 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 288/588] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:36.674929 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:36.676263 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] [instance: c5fa0677-75e7-4b3b-8813-37c81becbd7c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:36.685978 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.687103 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.687841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.689242 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.689960 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.690594 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.736005 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] HTTP exception thrown: Instance c5fa0677-75e7-4b3b-8813-37c81becbd7c could not be found. Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Request method failure captured: Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c HTTP/1.1 Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqnagIRLGtW4o5XwrhbQUCv8oOZGUW_nUE1X7zbxklJRH1xQ1W8EN_TlSO8EgdwtQxGn7C-s8WEbzHB4amLaYnQpFKCZDkyGD7BwBNX3WQIQLInlgzY35A1E27y-B9uFSwxYzG4l5_lawLobBjts30H6tEVti71tpzURHU7_X5fhN1w Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: 29f449e37cc6482eaca34671c7541c4b Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-VolumesSnapshotTestJSON-928626591 Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:25:36.739456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/29f449e37cc6482eaca34671c7541c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/29f449e37cc6482eaca34671c7541c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/29f449e37cc6482eaca34671c7541c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_29f449e37cc6482eaca34671c7541c4b"}]}] Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-VolumesSnapshotTestJSON-928626591 Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: 29f449e37cc6482eaca34671c7541c4b Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-928626591 Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-VolumesSnapshotTestJSON-928626591-project Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: c9dd5782e5f84ed68282cdda78ce909f Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-VolumesSnapshotTestJSON-928626591-project Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance c5fa0677-75e7-4b3b-8813-37c81becbd7c could not be found. Aug 31 00:25:36.742271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': 'c5fa0677-75e7-4b3b-8813-37c81becbd7c'} Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5fa0677-75e7-4b3b-8813-37c81becbd7c could not be found. Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:25:36.743692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5fa0677-75e7-4b3b-8813-37c81becbd7c could not be found. Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5fa0677-75e7-4b3b-8813-37c81becbd7c could not be found. Aug 31 00:25:36.746105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:25:36.757209 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] Returning 404 to user: Instance c5fa0677-75e7-4b3b-8813-37c81becbd7c could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:25:36.757209 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-63be5afd-8e0c-4681-86ab-2a7658ea08c1 tempest-VolumesSnapshotTestJSON-928626591 tempest-VolumesSnapshotTestJSON-928626591-project] 10.222.0.47 "GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c" status: 404 len: 111 microversion: 2.1 time: 0.075964 Aug 31 00:25:36.757209 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 289/589] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:36 2022] GET /compute/v2.1/servers/c5fa0677-75e7-4b3b-8813-37c81becbd7c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:25:36.757209 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-615029c1-968f-4de6-b55c-7a48961a2b7d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:36.757209 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-615029c1-968f-4de6-b55c-7a48961a2b7d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:36.768929 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-615029c1-968f-4de6-b55c-7a48961a2b7d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.769914 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-615029c1-968f-4de6-b55c-7a48961a2b7d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.770727 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-615029c1-968f-4de6-b55c-7a48961a2b7d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.772332 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-615029c1-968f-4de6-b55c-7a48961a2b7d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.773537 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-615029c1-968f-4de6-b55c-7a48961a2b7d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.774334 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-615029c1-968f-4de6-b55c-7a48961a2b7d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.799640 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-80d1027f-3639-46cc-87c5-816eb213dff8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:36.811785 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-80d1027f-3639-46cc-87c5-816eb213dff8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1604 microversion: 2.1 time: 0.335837 Aug 31 00:25:36.818537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 301/590] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:36 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1604 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:37.067510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-615029c1-968f-4de6-b55c-7a48961a2b7d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:37.084179 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-615029c1-968f-4de6-b55c-7a48961a2b7d tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1364 microversion: 2.1 time: 0.337105 Aug 31 00:25:37.087129 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 290/591] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:36 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1364 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:37.322564 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:37.324258 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:37.338037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.339131 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.340098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.341520 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.342198 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.342787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.447344 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:37.462681 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:37.466188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:37.468373 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4634831d-7a6e-45f3-80db-6601c1abca3c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1342 microversion: 2.20 time: 0.152361 Aug 31 00:25:37.469861 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 302/592] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:37 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1342 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:37.838398 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:37.840592 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:37.856105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.861518 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.862442 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.864061 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.865339 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.866434 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.935499 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.937286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.938389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.939670 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lazy-loading 'fault' on Instance uuid 1e22ddf8-4065-4933-a8db-68b53f82a42e {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:38.038701 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.051995 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4342107e-9bd6-4cca-a2a8-60e8736a9cdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 200 len: 1326 microversion: 2.1 time: 0.221263 Aug 31 00:25:38.053267 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 291/593] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:37 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 1326 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:38.113851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-68d5ce1b-c0b7-4b95-a686-f74949b82f78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:38.114936 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-68d5ce1b-c0b7-4b95-a686-f74949b82f78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:38.125905 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68d5ce1b-c0b7-4b95-a686-f74949b82f78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.126400 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68d5ce1b-c0b7-4b95-a686-f74949b82f78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.127141 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68d5ce1b-c0b7-4b95-a686-f74949b82f78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.127960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68d5ce1b-c0b7-4b95-a686-f74949b82f78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.128514 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68d5ce1b-c0b7-4b95-a686-f74949b82f78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.129021 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68d5ce1b-c0b7-4b95-a686-f74949b82f78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.507204 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:38.508046 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:38.518735 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.519476 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.520667 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.526409 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.527736 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.528819 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.583872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-68d5ce1b-c0b7-4b95-a686-f74949b82f78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.597685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-68d5ce1b-c0b7-4b95-a686-f74949b82f78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1555 microversion: 2.1 time: 0.490884 Aug 31 00:25:38.599205 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 303/594] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:38 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1555 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:38.638080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-659f35a2-e8a2-42c5-ad74-65e3f0cae9dd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:38.638716 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-659f35a2-e8a2-42c5-ad74-65e3f0cae9dd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:38.651230 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-659f35a2-e8a2-42c5-ad74-65e3f0cae9dd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.652366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-659f35a2-e8a2-42c5-ad74-65e3f0cae9dd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.653442 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-659f35a2-e8a2-42c5-ad74-65e3f0cae9dd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.655145 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-659f35a2-e8a2-42c5-ad74-65e3f0cae9dd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.656526 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-659f35a2-e8a2-42c5-ad74-65e3f0cae9dd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.657513 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-659f35a2-e8a2-42c5-ad74-65e3f0cae9dd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.863629 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.879756 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.882471 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.884285 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e92b5f9c-9a85-4b4f-a00f-6b9d83d30a6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1340 microversion: 2.20 time: 0.394283 Aug 31 00:25:38.884905 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 292/595] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:38 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1340 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:38.901163 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-659f35a2-e8a2-42c5-ad74-65e3f0cae9dd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.269671 Aug 31 00:25:38.902797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 304/596] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 31 00:25:38 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:39.088309 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:39.088309 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:39.099928 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.102198 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.103090 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:39.104856 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.105841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.106764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:39.149628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] HTTP exception thrown: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Request method failure captured: Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e HTTP/1.1 Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqlDf__9VhHXs1q6CC1yYxgwW6u6FioC34E8PhByXIKOjcmp5yz-avpA1e44tg3Ll4MuGFLnIMNZVBGyKqmYhChFVvXpu9L2-UZPolRYOiL3dL9KjQ85K_ud4qRGvS6wSdcB8yX78Pwa3oQ9CYYoeW-uCYfJ5tyPVksnhqzMBq5yco0 Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:25:39.153111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d71e648b9ff42fb8b29beabe01a5512"}]}] Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: bc018a253e0a4b0bb96097ce4cc72c21 Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:25:39.158925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '1e22ddf8-4065-4933-a8db-68b53f82a42e'} Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:25:39.165642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:25:39.171967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:25:39.176707 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Returning 404 to user: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:25:39.176707 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-94b7c5b5-faa7-4a50-a7de-ed52bd0faf86 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 404 len: 111 microversion: 2.1 time: 0.077212 Aug 31 00:25:39.176988 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c5829a5a-0d51-4819-b351-fea23e7624ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '.version_select at 0x7f1a3a8d40d0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:39.178647 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 293/597] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:39 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:25:39.206333 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c5829a5a-0d51-4819-b351-fea23e7624ee tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-852679302" status: 202 len: 0 microversion: 2.1 time: 0.036879 Aug 31 00:25:39.207247 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 305/598] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Aug 31 00:25:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-852679302 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:25:39.930627 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:39.932632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:39.941694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.942635 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.943540 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:39.944600 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.945416 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.946218 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.354715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:40.370659 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:40.373904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:40.376493 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-31bbb0a9-9614-440e-8574-44d673b446ae tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.452456 Aug 31 00:25:40.377546 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 294/599] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:39 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:40.786731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-439f8aaa-403c-4894-9972-b561ecb108e1 req-cf7e1c9a-8daf-4c2a-9e40-0d97472067ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "599f96bf-1137-4129-af25-5d61b32a4349", "tag": "e3547217-2be7-4db4-b82d-59dc6f1654fc"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:40.806524 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-439f8aaa-403c-4894-9972-b561ecb108e1 req-cf7e1c9a-8daf-4c2a-9e40-0d97472067ed service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:40.807340 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-439f8aaa-403c-4894-9972-b561ecb108e1 req-cf7e1c9a-8daf-4c2a-9e40-0d97472067ed service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:40.808076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-439f8aaa-403c-4894-9972-b561ecb108e1 req-cf7e1c9a-8daf-4c2a-9e40-0d97472067ed service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.830399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-439f8aaa-403c-4894-9972-b561ecb108e1 req-cf7e1c9a-8daf-4c2a-9e40-0d97472067ed service nova] Creating event network-changed:e3547217-2be7-4db4-b82d-59dc6f1654fc for instance 599f96bf-1137-4129-af25-5d61b32a4349 on hv-cinder-85221 Aug 31 00:25:40.839942 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-439f8aaa-403c-4894-9972-b561ecb108e1 req-cf7e1c9a-8daf-4c2a-9e40-0d97472067ed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061136 Aug 31 00:25:40.841127 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 306/600] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:41.220263 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-59ccdf35-ec2d-4a1b-afed-79ea849df70d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Action: 'create', calling method: .version_select at 0x7f1a3a97d8b0>, body: {"keypair": {"name": "tempest-keypair-1013446356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSPEskVpu3jjkHaHatDGs4wZaz6NSmh4qagVzf2UlqC0V/vINc/31SqWMaNs1rY1Sqdzw2Wddbf/uQZWJkGIF3SLHZAA+LGH5fCM/jKqk/e7fG0g2fWZw7B4rWaVzmJw=="}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:41.240549 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-59ccdf35-ec2d-4a1b-afed-79ea849df70d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Getting quotas for project 5d71e648b9ff42fb8b29beabe01a5512. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:25:41.245453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-59ccdf35-ec2d-4a1b-afed-79ea849df70d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Getting quotas for user bc018a253e0a4b0bb96097ce4cc72c21 and project 5d71e648b9ff42fb8b29beabe01a5512. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:25:41.278066 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-59ccdf35-ec2d-4a1b-afed-79ea849df70d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063021 Aug 31 00:25:41.286508 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 295/601] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 31 00:25:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:41.404486 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:41.406983 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:41.418377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:41.419294 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:41.420308 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:41.421782 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:41.422546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:41.423087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:41.770498 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:41.784486 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:41.786515 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:41.787880 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7014e8c8-2966-480f-abeb-ae42078a5bc9 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.391335 Aug 31 00:25:41.788951 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 307/602] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:41 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:42.834171 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:42.835382 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:42.845966 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:42.846898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:42.848881 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:42.849790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:42.850660 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:42.851207 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:43.269780 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:43.291742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:43.294672 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:43.297518 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-26777a3c-bd87-4692-9cd0-af3e48121293 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.470540 Aug 31 00:25:43.299051 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 296/603] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:42 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:43.444494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-f888b12f-9c36-4f04-a773-9494e4bd3acd req-1f34c3d6-3ec7-4e59-85ad-092f9bfa2337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698d47ed-0a7a-4601-87a9-beb0597d3045", "tag": "9e1236d0-86cd-45da-a9dc-878f6a1707a4"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:43.467124 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:43.469968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=6 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:43.486366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-f888b12f-9c36-4f04-a773-9494e4bd3acd req-1f34c3d6-3ec7-4e59-85ad-092f9bfa2337 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:43.487195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-f888b12f-9c36-4f04-a773-9494e4bd3acd req-1f34c3d6-3ec7-4e59-85ad-092f9bfa2337 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:43.487947 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-f888b12f-9c36-4f04-a773-9494e4bd3acd req-1f34c3d6-3ec7-4e59-85ad-092f9bfa2337 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:43.507991 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-f888b12f-9c36-4f04-a773-9494e4bd3acd req-1f34c3d6-3ec7-4e59-85ad-092f9bfa2337 service nova] Creating event network-changed:9e1236d0-86cd-45da-a9dc-878f6a1707a4 for instance 698d47ed-0a7a-4601-87a9-beb0597d3045 on hv-cinder-85221 Aug 31 00:25:43.513657 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-f888b12f-9c36-4f04-a773-9494e4bd3acd req-1f34c3d6-3ec7-4e59-85ad-092f9bfa2337 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082336 Aug 31 00:25:43.514287 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 308/604] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:43.534624 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1643780031", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d68da4d-e52e-4644-8ba2-67d235ba58ef"}], "security_groups": [{"name": "tempest-securitygroup--620532061"}], "key_name": "tempest-keypair-1013446356", "user_data": "}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:43.743227 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] validate_networks() for [('9d68da4d-e52e-4644-8ba2-67d235ba58ef', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:25:44.341496 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:44.343478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:44.358171 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.359654 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.360902 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.362512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.363520 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.364498 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.489378 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:25:44.490273 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:25:44.490592 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:25:44.491254 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:25:44.492394 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:25:44.506188 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.506853 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.507422 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.508414 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.509135 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.509692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.537562 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Getting quotas for project 5d71e648b9ff42fb8b29beabe01a5512. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:25:44.543853 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Getting quotas for user bc018a253e0a4b0bb96097ce4cc72c21 and project 5d71e648b9ff42fb8b29beabe01a5512. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:25:44.560578 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:25:44.563401 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:25:44.587710 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:44.603443 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:44.606761 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:44.609218 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-42ce81f0-3012-44c4-a288-20eb47ec70aa tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.275550 Aug 31 00:25:44.616615 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 309/605] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:44 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:44.621718 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1330ec94-97f7-4094-a1e4-c3e6a163794f tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.092644 Aug 31 00:25:44.622602 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 297/606] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:25:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:25:44.637694 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b29f1c7a-e1b9-493c-bde4-7dcd079349d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:44.638476 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b29f1c7a-e1b9-493c-bde4-7dcd079349d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:44.704427 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b29f1c7a-e1b9-493c-bde4-7dcd079349d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:44.712610 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b29f1c7a-e1b9-493c-bde4-7dcd079349d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1238 microversion: 2.1 time: 0.078967 Aug 31 00:25:44.713387 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 310/607] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:44 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:45.651856 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:45.654887 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:45.666452 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:45.667503 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:45.669803 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:45.671772 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:45.672693 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:45.673454 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:45.746200 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d327a294-036c-4eea-82ca-8c6c971a4b2a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:45.747511 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d327a294-036c-4eea-82ca-8c6c971a4b2a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:45.775386 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d327a294-036c-4eea-82ca-8c6c971a4b2a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:45.776596 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d327a294-036c-4eea-82ca-8c6c971a4b2a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:45.777591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d327a294-036c-4eea-82ca-8c6c971a4b2a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:45.781024 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d327a294-036c-4eea-82ca-8c6c971a4b2a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:45.781813 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d327a294-036c-4eea-82ca-8c6c971a4b2a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:45.785056 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d327a294-036c-4eea-82ca-8c6c971a4b2a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:45.938346 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d327a294-036c-4eea-82ca-8c6c971a4b2a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:45.958694 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d327a294-036c-4eea-82ca-8c6c971a4b2a tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1290 microversion: 2.1 time: 0.223361 Aug 31 00:25:45.959613 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 311/608] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:45 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1290 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:46.090947 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:46.102478 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:46.105156 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:46.106383 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cffd1570-5a3d-41f4-b8e6-591623a7674e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.468800 Aug 31 00:25:46.107251 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 298/609] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:45 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:46.988356 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f6f83cad-d905-492b-acf3-88982da1651d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:46.990284 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f6f83cad-d905-492b-acf3-88982da1651d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:47.000836 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6f83cad-d905-492b-acf3-88982da1651d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.005113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6f83cad-d905-492b-acf3-88982da1651d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.006396 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6f83cad-d905-492b-acf3-88982da1651d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.007506 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6f83cad-d905-492b-acf3-88982da1651d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.008287 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6f83cad-d905-492b-acf3-88982da1651d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.009254 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6f83cad-d905-492b-acf3-88982da1651d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.120439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f6f83cad-d905-492b-acf3-88982da1651d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.136914 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:47.137937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:47.140932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f6f83cad-d905-492b-acf3-88982da1651d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1296 microversion: 2.1 time: 0.156204 Aug 31 00:25:47.141948 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 312/610] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:46 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1296 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:47.156329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.156329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.156329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.156936 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.157546 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.158086 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.386174 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.398628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.400428 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.401929 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-995da3fb-4760-4938-8e73-2d719e2e7199 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.271948 Aug 31 00:25:47.402643 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 299/611] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:47 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:48.181110 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-da8ed00d-b89a-4bc8-b32a-9d719a136a39 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:48.182320 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-da8ed00d-b89a-4bc8-b32a-9d719a136a39 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:48.194233 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da8ed00d-b89a-4bc8-b32a-9d719a136a39 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:48.195012 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da8ed00d-b89a-4bc8-b32a-9d719a136a39 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:48.195762 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da8ed00d-b89a-4bc8-b32a-9d719a136a39 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:48.197051 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da8ed00d-b89a-4bc8-b32a-9d719a136a39 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:48.197876 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da8ed00d-b89a-4bc8-b32a-9d719a136a39 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:48.198542 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da8ed00d-b89a-4bc8-b32a-9d719a136a39 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:48.387484 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-da8ed00d-b89a-4bc8-b32a-9d719a136a39 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.397693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-da8ed00d-b89a-4bc8-b32a-9d719a136a39 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1363 microversion: 2.1 time: 0.223856 Aug 31 00:25:48.398557 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 313/612] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:48 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:48.444095 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:48.445123 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:48.456784 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:48.457840 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:48.458565 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:48.459724 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:48.460468 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:48.461126 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:48.485235 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:48.645344 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.654955 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.657391 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.658558 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-034ad9a0-ae13-40c3-9356-64df50ff80da tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.222611 Aug 31 00:25:48.659130 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 300/613] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:48 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:49.426957 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-cfab5ddd-606a-4225-9778-31cf0fb98914 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:49.428081 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-cfab5ddd-606a-4225-9778-31cf0fb98914 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:49.439432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cfab5ddd-606a-4225-9778-31cf0fb98914 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.440278 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cfab5ddd-606a-4225-9778-31cf0fb98914 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.441035 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cfab5ddd-606a-4225-9778-31cf0fb98914 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.442804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cfab5ddd-606a-4225-9778-31cf0fb98914 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.443777 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cfab5ddd-606a-4225-9778-31cf0fb98914 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.444710 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cfab5ddd-606a-4225-9778-31cf0fb98914 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.450129 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=100 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:49.608449 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-cfab5ddd-606a-4225-9778-31cf0fb98914 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:49.617615 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-cfab5ddd-606a-4225-9778-31cf0fb98914 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1363 microversion: 2.1 time: 0.196577 Aug 31 00:25:49.618208 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 314/614] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:49 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:49.681771 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:49.682593 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:49.690126 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.690625 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.691060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.691824 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.692363 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.692791 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.850114 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:49.865640 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:49.868494 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:49.870690 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6f69bbfd-6bc6-4a79-b177-f69d1063d5f3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.192691 Aug 31 00:25:49.871758 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 301/615] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:49 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:50.643867 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-cab0a53f-f70a-4ad8-9dcc-055a06bff84d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:50.645316 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-cab0a53f-f70a-4ad8-9dcc-055a06bff84d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:50.657117 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab0a53f-f70a-4ad8-9dcc-055a06bff84d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.657900 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab0a53f-f70a-4ad8-9dcc-055a06bff84d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.658694 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab0a53f-f70a-4ad8-9dcc-055a06bff84d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.659956 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab0a53f-f70a-4ad8-9dcc-055a06bff84d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.660874 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab0a53f-f70a-4ad8-9dcc-055a06bff84d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.661646 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab0a53f-f70a-4ad8-9dcc-055a06bff84d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.895812 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:50.897521 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:50.905733 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.906605 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.907412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.908570 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.909244 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.909824 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.926112 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-cab0a53f-f70a-4ad8-9dcc-055a06bff84d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:50.942981 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-cab0a53f-f70a-4ad8-9dcc-055a06bff84d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1363 microversion: 2.1 time: 0.306704 Aug 31 00:25:50.944863 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 315/616] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:50 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:51.144201 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-eefc9974-31f1-4c09-a8bb-fc4e7384f4b8 req-f8ad0eb2-f20c-4fc4-b950-6cc1ca0ab0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c64bfe1-3a21-410a-8b62-07114788167c", "tag": "9b0b524b-6589-4a3f-ad55-3ea2433fdd58"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:51.176360 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-eefc9974-31f1-4c09-a8bb-fc4e7384f4b8 req-f8ad0eb2-f20c-4fc4-b950-6cc1ca0ab0b8 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.177164 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-eefc9974-31f1-4c09-a8bb-fc4e7384f4b8 req-f8ad0eb2-f20c-4fc4-b950-6cc1ca0ab0b8 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.177845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-eefc9974-31f1-4c09-a8bb-fc4e7384f4b8 req-f8ad0eb2-f20c-4fc4-b950-6cc1ca0ab0b8 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.195087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-eefc9974-31f1-4c09-a8bb-fc4e7384f4b8 req-f8ad0eb2-f20c-4fc4-b950-6cc1ca0ab0b8 service nova] Creating event network-changed:9b0b524b-6589-4a3f-ad55-3ea2433fdd58 for instance 5c64bfe1-3a21-410a-8b62-07114788167c on hv-cinder-85221 Aug 31 00:25:51.201382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-eefc9974-31f1-4c09-a8bb-fc4e7384f4b8 req-f8ad0eb2-f20c-4fc4-b950-6cc1ca0ab0b8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066355 Aug 31 00:25:51.203152 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 316/617] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:51.272020 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.282878 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.284512 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.285855 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c908e587-022c-4be5-8432-b47cf02df034 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.395092 Aug 31 00:25:51.286889 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 302/618] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:50 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:51.980023 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5820dad7-1ac7-4c8d-a47e-d67d30c84ce5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:51.980925 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5820dad7-1ac7-4c8d-a47e-d67d30c84ce5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:51.989260 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5820dad7-1ac7-4c8d-a47e-d67d30c84ce5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.989260 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5820dad7-1ac7-4c8d-a47e-d67d30c84ce5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.989701 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5820dad7-1ac7-4c8d-a47e-d67d30c84ce5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.990430 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5820dad7-1ac7-4c8d-a47e-d67d30c84ce5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.990883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5820dad7-1ac7-4c8d-a47e-d67d30c84ce5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.991428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5820dad7-1ac7-4c8d-a47e-d67d30c84ce5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.170228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5820dad7-1ac7-4c8d-a47e-d67d30c84ce5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:52.185576 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5820dad7-1ac7-4c8d-a47e-d67d30c84ce5 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1363 microversion: 2.1 time: 0.210520 Aug 31 00:25:52.187403 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 317/619] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:51 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:52.329340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:52.330504 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:52.337894 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.338932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-0ee09ef9-b793-4bca-9637-05841d9e596f req-2417b977-5fef-4789-ac7c-5701b1bfaf06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698d47ed-0a7a-4601-87a9-beb0597d3045", "name": "network-vif-plugged", "status": "completed", "tag": "9e1236d0-86cd-45da-a9dc-878f6a1707a4"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:52.339690 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.340284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.342082 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.342082 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.345454 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.367402 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-0ee09ef9-b793-4bca-9637-05841d9e596f req-2417b977-5fef-4789-ac7c-5701b1bfaf06 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.368653 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-0ee09ef9-b793-4bca-9637-05841d9e596f req-2417b977-5fef-4789-ac7c-5701b1bfaf06 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.370107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-0ee09ef9-b793-4bca-9637-05841d9e596f req-2417b977-5fef-4789-ac7c-5701b1bfaf06 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.395388 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-0ee09ef9-b793-4bca-9637-05841d9e596f req-2417b977-5fef-4789-ac7c-5701b1bfaf06 service nova] Creating event network-vif-plugged:9e1236d0-86cd-45da-a9dc-878f6a1707a4 for instance 698d47ed-0a7a-4601-87a9-beb0597d3045 on hv-cinder-85221 Aug 31 00:25:52.404517 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-0ee09ef9-b793-4bca-9637-05841d9e596f req-2417b977-5fef-4789-ac7c-5701b1bfaf06 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074456 Aug 31 00:25:52.406168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 318/620] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:52.531693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e017beca-8855-48a5-bd4d-0d04c6283d10 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:52.532764 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e017beca-8855-48a5-bd4d-0d04c6283d10 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:52.544374 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e017beca-8855-48a5-bd4d-0d04c6283d10 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.545264 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e017beca-8855-48a5-bd4d-0d04c6283d10 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.546257 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:52.546574 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e017beca-8855-48a5-bd4d-0d04c6283d10 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.547909 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e017beca-8855-48a5-bd4d-0d04c6283d10 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.548769 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e017beca-8855-48a5-bd4d-0d04c6283d10 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.549511 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e017beca-8855-48a5-bd4d-0d04c6283d10 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.558498 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:52.559997 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:52.561887 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a3c9f122-faaa-4ccb-8eeb-aa845b424166 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.238035 Aug 31 00:25:52.562876 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 303/621] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:52 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:52.663924 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-e017beca-8855-48a5-bd4d-0d04c6283d10 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lazy-loading 'services' on Instance uuid 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:52.751943 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e017beca-8855-48a5-bd4d-0d04c6283d10 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "DELETE /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments/cc8320c0-5911-4a69-a1bc-f73992b64e41" status: 202 len: 0 microversion: 2.1 time: 0.229238 Aug 31 00:25:52.752722 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 319/622] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:25:52 2022] DELETE /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments/cc8320c0-5911-4a69-a1bc-f73992b64e41 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:25:52.761981 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-dc6e55c4-da39-40e4-aa0c-413fe6b2efa1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:52.764498 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-dc6e55c4-da39-40e4-aa0c-413fe6b2efa1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:52.771099 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dc6e55c4-da39-40e4-aa0c-413fe6b2efa1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.771592 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dc6e55c4-da39-40e4-aa0c-413fe6b2efa1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.772053 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dc6e55c4-da39-40e4-aa0c-413fe6b2efa1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.772811 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dc6e55c4-da39-40e4-aa0c-413fe6b2efa1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.773528 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dc6e55c4-da39-40e4-aa0c-413fe6b2efa1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.773951 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dc6e55c4-da39-40e4-aa0c-413fe6b2efa1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.810090 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-dc6e55c4-da39-40e4-aa0c-413fe6b2efa1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052202 Aug 31 00:25:52.810557 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 304/623] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:25:52 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:25:53.224913 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-012d9b7f-e209-4190-9286-ee9c36eddbf0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:53.225750 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-012d9b7f-e209-4190-9286-ee9c36eddbf0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:53.234085 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-012d9b7f-e209-4190-9286-ee9c36eddbf0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.234701 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-012d9b7f-e209-4190-9286-ee9c36eddbf0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.235330 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-012d9b7f-e209-4190-9286-ee9c36eddbf0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.236261 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-012d9b7f-e209-4190-9286-ee9c36eddbf0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.236813 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-012d9b7f-e209-4190-9286-ee9c36eddbf0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.237329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-012d9b7f-e209-4190-9286-ee9c36eddbf0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.385333 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-012d9b7f-e209-4190-9286-ee9c36eddbf0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.394528 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-012d9b7f-e209-4190-9286-ee9c36eddbf0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1363 microversion: 2.1 time: 0.176516 Aug 31 00:25:53.395144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 320/624] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:53 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:53.588658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:53.590276 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:53.598916 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.599694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.600419 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.601353 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.601985 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.602586 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.823658 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ae2842af-0760-4a7b-b4fe-393bad312dae tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:53.828104 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ae2842af-0760-4a7b-b4fe-393bad312dae tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:53.837206 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2842af-0760-4a7b-b4fe-393bad312dae tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.837753 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2842af-0760-4a7b-b4fe-393bad312dae tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.838589 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2842af-0760-4a7b-b4fe-393bad312dae tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.839603 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2842af-0760-4a7b-b4fe-393bad312dae tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.840064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2842af-0760-4a7b-b4fe-393bad312dae tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.840948 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2842af-0760-4a7b-b4fe-393bad312dae tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.885254 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ae2842af-0760-4a7b-b4fe-393bad312dae tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066374 Aug 31 00:25:53.885526 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.892937 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 321/625] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:25:53 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:25:53.898773 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.900291 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.901454 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e26642fc-748b-44a5-bfff-6ef8fc277389 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.317716 Aug 31 00:25:53.902040 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 305/626] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:53 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:54.426516 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4054fcf1-3c61-4571-adc4-01a833a4c730 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:54.427381 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4054fcf1-3c61-4571-adc4-01a833a4c730 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:54.434677 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4054fcf1-3c61-4571-adc4-01a833a4c730 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.435352 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4054fcf1-3c61-4571-adc4-01a833a4c730 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.435576 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4054fcf1-3c61-4571-adc4-01a833a4c730 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.436841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4054fcf1-3c61-4571-adc4-01a833a4c730 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.437568 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4054fcf1-3c61-4571-adc4-01a833a4c730 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.438181 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4054fcf1-3c61-4571-adc4-01a833a4c730 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.610237 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4054fcf1-3c61-4571-adc4-01a833a4c730 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:54.619615 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4054fcf1-3c61-4571-adc4-01a833a4c730 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1363 microversion: 2.1 time: 0.197018 Aug 31 00:25:54.620344 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 322/627] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:54 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:54.901402 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4d65b03c-d117-434a-b30b-9ccf2dfbaccb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:54.903759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4d65b03c-d117-434a-b30b-9ccf2dfbaccb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:54.906025 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:54.906930 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=16 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:54.914483 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d65b03c-d117-434a-b30b-9ccf2dfbaccb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.915324 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d65b03c-d117-434a-b30b-9ccf2dfbaccb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.916121 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d65b03c-d117-434a-b30b-9ccf2dfbaccb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.917500 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d65b03c-d117-434a-b30b-9ccf2dfbaccb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.918390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d65b03c-d117-434a-b30b-9ccf2dfbaccb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.919232 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d65b03c-d117-434a-b30b-9ccf2dfbaccb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.930841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:54.931695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:54.934348 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:54.943326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.944033 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.944633 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.945497 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.946297 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.947033 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.984396 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4d65b03c-d117-434a-b30b-9ccf2dfbaccb tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086293 Aug 31 00:25:54.985468 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 306/628] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:25:54 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 00:25:55.089054 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ebf1d012-151f-4989-9afb-10f51a156af7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:55.089928 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ebf1d012-151f-4989-9afb-10f51a156af7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:55.101922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ebf1d012-151f-4989-9afb-10f51a156af7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.102886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ebf1d012-151f-4989-9afb-10f51a156af7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.103680 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ebf1d012-151f-4989-9afb-10f51a156af7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.105017 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ebf1d012-151f-4989-9afb-10f51a156af7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.105874 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ebf1d012-151f-4989-9afb-10f51a156af7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.106651 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ebf1d012-151f-4989-9afb-10f51a156af7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.144502 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ebf1d012-151f-4989-9afb-10f51a156af7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:25:55.159452 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:55.174670 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:55.177910 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:55.179922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5a781459-c77d-4bc9-bb99-d096bea67744 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1408 microversion: 2.20 time: 0.255354 Aug 31 00:25:55.180977 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 323/629] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:54 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:55.263287 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ebf1d012-151f-4989-9afb-10f51a156af7 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "DELETE /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 204 len: 0 microversion: 2.1 time: 0.178777 Aug 31 00:25:55.263985 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 307/630] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:25:55 2022] DELETE /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:25:55.274597 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-57a4ee20-5b0c-4580-ba6d-d78a36338e2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:55.275548 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-57a4ee20-5b0c-4580-ba6d-d78a36338e2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:55.284126 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57a4ee20-5b0c-4580-ba6d-d78a36338e2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.284781 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57a4ee20-5b0c-4580-ba6d-d78a36338e2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.285309 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57a4ee20-5b0c-4580-ba6d-d78a36338e2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.286263 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57a4ee20-5b0c-4580-ba6d-d78a36338e2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.286881 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57a4ee20-5b0c-4580-ba6d-d78a36338e2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.287401 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57a4ee20-5b0c-4580-ba6d-d78a36338e2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.472969 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-57a4ee20-5b0c-4580-ba6d-d78a36338e2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:55.486446 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-57a4ee20-5b0c-4580-ba6d-d78a36338e2a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1690 microversion: 2.1 time: 0.216991 Aug 31 00:25:55.487559 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 324/631] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:55 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1690 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:55.642716 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-35bd500c-5ed8-4b52-b217-13510fb1d2e1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:55.643329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-35bd500c-5ed8-4b52-b217-13510fb1d2e1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:55.650325 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35bd500c-5ed8-4b52-b217-13510fb1d2e1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.650807 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35bd500c-5ed8-4b52-b217-13510fb1d2e1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.651241 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35bd500c-5ed8-4b52-b217-13510fb1d2e1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.651960 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35bd500c-5ed8-4b52-b217-13510fb1d2e1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.652464 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35bd500c-5ed8-4b52-b217-13510fb1d2e1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.652901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35bd500c-5ed8-4b52-b217-13510fb1d2e1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.819324 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-35bd500c-5ed8-4b52-b217-13510fb1d2e1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:55.830754 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-35bd500c-5ed8-4b52-b217-13510fb1d2e1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1363 microversion: 2.1 time: 0.192893 Aug 31 00:25:55.831839 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 308/632] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:55 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:56.220117 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:56.220684 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:56.228915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.229741 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.230383 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.231390 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.232141 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.232896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.388779 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-4faa35b9-73f0-41b6-b69b-af5cb4fd2c4e req-cac3de17-87b9-4378-8e44-cc4029a60875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c64bfe1-3a21-410a-8b62-07114788167c", "name": "network-vif-plugged", "status": "completed", "tag": "9b0b524b-6589-4a3f-ad55-3ea2433fdd58"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:56.411990 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-4faa35b9-73f0-41b6-b69b-af5cb4fd2c4e req-cac3de17-87b9-4378-8e44-cc4029a60875 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.412872 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-4faa35b9-73f0-41b6-b69b-af5cb4fd2c4e req-cac3de17-87b9-4378-8e44-cc4029a60875 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.413642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-4faa35b9-73f0-41b6-b69b-af5cb4fd2c4e req-cac3de17-87b9-4378-8e44-cc4029a60875 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.436575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-4faa35b9-73f0-41b6-b69b-af5cb4fd2c4e req-cac3de17-87b9-4378-8e44-cc4029a60875 service nova] Creating event network-vif-plugged:9b0b524b-6589-4a3f-ad55-3ea2433fdd58 for instance 5c64bfe1-3a21-410a-8b62-07114788167c on hv-cinder-85221 Aug 31 00:25:56.447697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-4faa35b9-73f0-41b6-b69b-af5cb4fd2c4e req-cac3de17-87b9-4378-8e44-cc4029a60875 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065924 Aug 31 00:25:56.449412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 309/633] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:56.456483 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:56.467348 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:56.470209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:56.471926 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7c84ce84-2776-4b9e-a865-553e5c70214a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1599 microversion: 2.20 time: 0.257637 Aug 31 00:25:56.472700 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 325/634] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:56 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1599 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:56.505798 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ca35af8e-f613-4938-b831-16b07724fb67 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:56.506805 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ca35af8e-f613-4938-b831-16b07724fb67 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:56.518754 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3b64c45f-5bdd-45ce-b45e-bbab7c0e7464 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:56.519689 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca35af8e-f613-4938-b831-16b07724fb67 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.519689 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca35af8e-f613-4938-b831-16b07724fb67 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.520020 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3b64c45f-5bdd-45ce-b45e-bbab7c0e7464 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:56.520508 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca35af8e-f613-4938-b831-16b07724fb67 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.521815 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca35af8e-f613-4938-b831-16b07724fb67 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.522684 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca35af8e-f613-4938-b831-16b07724fb67 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.523703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca35af8e-f613-4938-b831-16b07724fb67 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.527698 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b64c45f-5bdd-45ce-b45e-bbab7c0e7464 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.528374 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b64c45f-5bdd-45ce-b45e-bbab7c0e7464 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.528805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b64c45f-5bdd-45ce-b45e-bbab7c0e7464 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.529604 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b64c45f-5bdd-45ce-b45e-bbab7c0e7464 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.530632 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b64c45f-5bdd-45ce-b45e-bbab7c0e7464 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.531065 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b64c45f-5bdd-45ce-b45e-bbab7c0e7464 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.716201 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ca35af8e-f613-4938-b831-16b07724fb67 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.218330 Aug 31 00:25:56.719112 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 310/635] 10.222.0.47 () {60 vars in 1316 bytes} [Wed Aug 31 00:25:56 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:25:56.799927 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3b64c45f-5bdd-45ce-b45e-bbab7c0e7464 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:56.813625 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3b64c45f-5bdd-45ce-b45e-bbab7c0e7464 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1690 microversion: 2.1 time: 0.299699 Aug 31 00:25:56.814328 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 326/636] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:56 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1690 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:56.855584 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-edaf0c00-8bc9-411f-81cb-02833e1bb294 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:56.856396 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-edaf0c00-8bc9-411f-81cb-02833e1bb294 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:56.863577 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaf0c00-8bc9-411f-81cb-02833e1bb294 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.864050 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaf0c00-8bc9-411f-81cb-02833e1bb294 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.864524 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaf0c00-8bc9-411f-81cb-02833e1bb294 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.865258 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaf0c00-8bc9-411f-81cb-02833e1bb294 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.865804 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaf0c00-8bc9-411f-81cb-02833e1bb294 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.866243 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-edaf0c00-8bc9-411f-81cb-02833e1bb294 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:57.089220 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-edaf0c00-8bc9-411f-81cb-02833e1bb294 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:57.098086 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-edaf0c00-8bc9-411f-81cb-02833e1bb294 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1363 microversion: 2.1 time: 0.246705 Aug 31 00:25:57.098692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 311/637] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:56 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:57.841402 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f5f6653a-b403-4619-b717-6d335e6467a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:57.843226 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f5f6653a-b403-4619-b717-6d335e6467a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:57.856357 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5f6653a-b403-4619-b717-6d335e6467a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:57.857247 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5f6653a-b403-4619-b717-6d335e6467a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:57.858363 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5f6653a-b403-4619-b717-6d335e6467a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:57.859803 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5f6653a-b403-4619-b717-6d335e6467a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:57.860659 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5f6653a-b403-4619-b717-6d335e6467a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:57.861442 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f5f6653a-b403-4619-b717-6d335e6467a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.010273 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-dfca1148-725c-4c63-bddb-ad91705c1784 req-8e63500f-a6fe-485a-a883-cc2244cf3272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698d47ed-0a7a-4601-87a9-beb0597d3045", "tag": "9e1236d0-86cd-45da-a9dc-878f6a1707a4"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:58.027265 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-dfca1148-725c-4c63-bddb-ad91705c1784 req-8e63500f-a6fe-485a-a883-cc2244cf3272 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.028202 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-dfca1148-725c-4c63-bddb-ad91705c1784 req-8e63500f-a6fe-485a-a883-cc2244cf3272 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.028656 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-dfca1148-725c-4c63-bddb-ad91705c1784 req-8e63500f-a6fe-485a-a883-cc2244cf3272 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.043325 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-dfca1148-725c-4c63-bddb-ad91705c1784 req-8e63500f-a6fe-485a-a883-cc2244cf3272 service nova] Creating event network-changed:9e1236d0-86cd-45da-a9dc-878f6a1707a4 for instance 698d47ed-0a7a-4601-87a9-beb0597d3045 on hv-cinder-85221 Aug 31 00:25:58.052473 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-dfca1148-725c-4c63-bddb-ad91705c1784 req-8e63500f-a6fe-485a-a883-cc2244cf3272 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048709 Aug 31 00:25:58.053105 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 312/638] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:58.126690 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cda5437c-097b-45f4-8b04-24391af836e9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:58.128332 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-cda5437c-097b-45f4-8b04-24391af836e9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:58.138735 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f5f6653a-b403-4619-b717-6d335e6467a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:58.140516 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cda5437c-097b-45f4-8b04-24391af836e9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.141445 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cda5437c-097b-45f4-8b04-24391af836e9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.142186 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cda5437c-097b-45f4-8b04-24391af836e9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.143795 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cda5437c-097b-45f4-8b04-24391af836e9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.144706 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cda5437c-097b-45f4-8b04-24391af836e9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.145469 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cda5437c-097b-45f4-8b04-24391af836e9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.149571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f5f6653a-b403-4619-b717-6d335e6467a1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1690 microversion: 2.1 time: 0.316227 Aug 31 00:25:58.150727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 327/639] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:57 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1690 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:58.374646 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cda5437c-097b-45f4-8b04-24391af836e9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:58.384667 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cda5437c-097b-45f4-8b04-24391af836e9 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1363 microversion: 2.1 time: 0.266430 Aug 31 00:25:58.385373 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 313/640] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:58 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:59.189493 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f219b973-24f5-4239-b5a0-733a35046b32 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:59.191711 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f219b973-24f5-4239-b5a0-733a35046b32 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:59.208653 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f219b973-24f5-4239-b5a0-733a35046b32 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.209516 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f219b973-24f5-4239-b5a0-733a35046b32 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.210293 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f219b973-24f5-4239-b5a0-733a35046b32 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.211612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f219b973-24f5-4239-b5a0-733a35046b32 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.212497 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f219b973-24f5-4239-b5a0-733a35046b32 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.213198 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f219b973-24f5-4239-b5a0-733a35046b32 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.411173 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e3b62664-23f8-474d-9ce2-dfc95ae2702c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:59.412081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e3b62664-23f8-474d-9ce2-dfc95ae2702c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:59.423048 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e3b62664-23f8-474d-9ce2-dfc95ae2702c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.424369 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e3b62664-23f8-474d-9ce2-dfc95ae2702c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.425738 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e3b62664-23f8-474d-9ce2-dfc95ae2702c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.427495 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e3b62664-23f8-474d-9ce2-dfc95ae2702c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.428833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e3b62664-23f8-474d-9ce2-dfc95ae2702c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.429982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e3b62664-23f8-474d-9ce2-dfc95ae2702c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.446607 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f219b973-24f5-4239-b5a0-733a35046b32 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:59.473856 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f219b973-24f5-4239-b5a0-733a35046b32 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1690 microversion: 2.1 time: 0.289612 Aug 31 00:25:59.474896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 328/641] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:59 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1690 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:59.669284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e3b62664-23f8-474d-9ce2-dfc95ae2702c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:59.682701 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e3b62664-23f8-474d-9ce2-dfc95ae2702c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1363 microversion: 2.1 time: 0.276645 Aug 31 00:25:59.683554 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 314/642] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:59 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:00.503192 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3e86db78-1875-414d-ac97-94473409e6a5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:00.504362 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3e86db78-1875-414d-ac97-94473409e6a5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:00.518564 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e86db78-1875-414d-ac97-94473409e6a5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.519542 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e86db78-1875-414d-ac97-94473409e6a5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.520459 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e86db78-1875-414d-ac97-94473409e6a5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.522122 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e86db78-1875-414d-ac97-94473409e6a5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.523479 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e86db78-1875-414d-ac97-94473409e6a5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.524506 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3e86db78-1875-414d-ac97-94473409e6a5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.708230 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d7b09fd0-56e4-4293-a2a4-097e19fbc051 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:00.709270 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d7b09fd0-56e4-4293-a2a4-097e19fbc051 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:00.719537 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7b09fd0-56e4-4293-a2a4-097e19fbc051 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.720290 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7b09fd0-56e4-4293-a2a4-097e19fbc051 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.720919 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7b09fd0-56e4-4293-a2a4-097e19fbc051 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.721882 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7b09fd0-56e4-4293-a2a4-097e19fbc051 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.722525 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7b09fd0-56e4-4293-a2a4-097e19fbc051 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.723266 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7b09fd0-56e4-4293-a2a4-097e19fbc051 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:01.012062 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3e86db78-1875-414d-ac97-94473409e6a5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:01.029241 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3e86db78-1875-414d-ac97-94473409e6a5 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1690 microversion: 2.1 time: 0.533978 Aug 31 00:26:01.031027 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 329/643] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:00 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1690 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:01.112700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d7b09fd0-56e4-4293-a2a4-097e19fbc051 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:01.124907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d7b09fd0-56e4-4293-a2a4-097e19fbc051 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1363 microversion: 2.1 time: 0.420179 Aug 31 00:26:01.125971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 315/644] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:00 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:01.540542 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-3d069643-d025-4250-a4da-acdee26384c9 req-ae4dd980-7466-4fb9-9b7c-a088a38461c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e8d6e3-f38c-4d75-8f36-60f17fec87a4", "name": "network-vif-deleted", "tag": "bb85f003-67c3-4300-9f2a-5e9218c74a03"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:01.562241 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3d069643-d025-4250-a4da-acdee26384c9 req-ae4dd980-7466-4fb9-9b7c-a088a38461c7 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:01.563155 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3d069643-d025-4250-a4da-acdee26384c9 req-ae4dd980-7466-4fb9-9b7c-a088a38461c7 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:01.563933 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3d069643-d025-4250-a4da-acdee26384c9 req-ae4dd980-7466-4fb9-9b7c-a088a38461c7 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:01.589594 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-3d069643-d025-4250-a4da-acdee26384c9 req-ae4dd980-7466-4fb9-9b7c-a088a38461c7 service nova] Creating event network-vif-deleted:bb85f003-67c3-4300-9f2a-5e9218c74a03 for instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 on hv-cinder-85221 Aug 31 00:26:01.600260 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-3d069643-d025-4250-a4da-acdee26384c9 req-ae4dd980-7466-4fb9-9b7c-a088a38461c7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066620 Aug 31 00:26:01.601317 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 330/645] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:02.061916 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:02.066679 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:02.082085 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.083356 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.084378 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.087313 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.091256 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.092877 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.152708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5a458421-8413-4463-a041-9d0fc4a8b70b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:02.158027 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5a458421-8413-4463-a041-9d0fc4a8b70b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:02.172500 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a458421-8413-4463-a041-9d0fc4a8b70b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.173398 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a458421-8413-4463-a041-9d0fc4a8b70b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.174052 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a458421-8413-4463-a041-9d0fc4a8b70b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.174986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a458421-8413-4463-a041-9d0fc4a8b70b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.175867 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a458421-8413-4463-a041-9d0fc4a8b70b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.176491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5a458421-8413-4463-a041-9d0fc4a8b70b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.199532 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.200913 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.202712 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.204610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lazy-loading 'fault' on Instance uuid 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:02.379745 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:02.404458 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:02.411048 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3613603c-ad14-4883-a80a-2b118b685cc3 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 200 len: 1335 microversion: 2.1 time: 0.357199 Aug 31 00:26:02.425446 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 316/646] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:02 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 1335 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:02.564628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5a458421-8413-4463-a041-9d0fc4a8b70b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:02.576014 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5a458421-8413-4463-a041-9d0fc4a8b70b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1549 microversion: 2.1 time: 0.431048 Aug 31 00:26:02.578044 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 331/647] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:02 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1549 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:02.599815 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-10db8ff5-2b6f-4841-b839-fbed4b629b9c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:02.600346 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-10db8ff5-2b6f-4841-b839-fbed4b629b9c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:02.609341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10db8ff5-2b6f-4841-b839-fbed4b629b9c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.609843 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10db8ff5-2b6f-4841-b839-fbed4b629b9c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.610284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10db8ff5-2b6f-4841-b839-fbed4b629b9c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.611230 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10db8ff5-2b6f-4841-b839-fbed4b629b9c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.611715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10db8ff5-2b6f-4841-b839-fbed4b629b9c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.612145 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-10db8ff5-2b6f-4841-b839-fbed4b629b9c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.762655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-10db8ff5-2b6f-4841-b839-fbed4b629b9c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166748 Aug 31 00:26:02.764120 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 317/648] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 31 00:26:02 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:26:03.445354 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:03.445979 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 76e8d6e3-f38c-4d75-8f36-60f17fec87a4] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:03.456335 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:03.456832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:03.465017 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:03.465805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:03.466478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:03.467088 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:03.470749 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:03.492059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] HTTP exception thrown: Instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 could not be found. Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Request method failure captured: Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 HTTP/1.1 Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYalK_ZiTauZ-9XDO7haKEIuXnKbHhABMonOFQP-rI78FINZ2XVrTy8p1zk3RjEkVar9pkgMdmtZNVYMAs-uZPoCRzB4Th807o4TLWVOTd_MNqGbppsFiV6_vn3vGaC-JcYOQFNXv-OJkCGApOtlB6lTEq6yiN8b9AAW0Sat2RBB8 Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: af873e6a013c457aa2407fb24423ddc1 Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:26:03.504537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_af873e6a013c457aa2407fb24423ddc1"}]}] Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: af873e6a013c457aa2407fb24423ddc1 Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-ServerRescueNegativeTestJSON-1960179446-project Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: f8ffd2d3c0c141118a7a9a5696c383e1 Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1960179446-project Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 could not be found. Aug 31 00:26:03.506315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '76e8d6e3-f38c-4d75-8f36-60f17fec87a4'} Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 could not be found. Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:26:03.507217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 could not be found. Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 could not be found. Aug 31 00:26:03.508850 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:03.511553 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Returning 404 to user: Instance 76e8d6e3-f38c-4d75-8f36-60f17fec87a4 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:26:03.512845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-46586f4c-2552-4754-a2f2-659a0b741a2d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4" status: 404 len: 111 microversion: 2.1 time: 0.071544 Aug 31 00:26:03.528796 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d00a0c00-3cfd-4101-8c22-6f3db8c26894 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '.version_select at 0x7f1a3a8beca0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:03.532576 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 332/649] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:03 2022] GET /compute/v2.1/servers/76e8d6e3-f38c-4d75-8f36-60f17fec87a4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:26:03.545925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:03.597935 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d00a0c00-3cfd-4101-8c22-6f3db8c26894 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-747050452" status: 202 len: 0 microversion: 2.1 time: 0.073011 Aug 31 00:26:03.603771 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 318/650] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Aug 31 00:26:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-747050452 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:26:05.058169 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-0ee390dc-5a03-4eb5-94c5-fb72e7f46ab5 req-6c097c78-d44b-47f9-8323-b301df3bc5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c64bfe1-3a21-410a-8b62-07114788167c", "tag": "9b0b524b-6589-4a3f-ad55-3ea2433fdd58"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:05.078226 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:05.082998 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-0ee390dc-5a03-4eb5-94c5-fb72e7f46ab5 req-6c097c78-d44b-47f9-8323-b301df3bc5b6 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:05.084929 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-0ee390dc-5a03-4eb5-94c5-fb72e7f46ab5 req-6c097c78-d44b-47f9-8323-b301df3bc5b6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:05.086052 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-0ee390dc-5a03-4eb5-94c5-fb72e7f46ab5 req-6c097c78-d44b-47f9-8323-b301df3bc5b6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:05.116580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-0ee390dc-5a03-4eb5-94c5-fb72e7f46ab5 req-6c097c78-d44b-47f9-8323-b301df3bc5b6 service nova] Creating event network-changed:9b0b524b-6589-4a3f-ad55-3ea2433fdd58 for instance 5c64bfe1-3a21-410a-8b62-07114788167c on hv-cinder-85221 Aug 31 00:26:05.127601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-0ee390dc-5a03-4eb5-94c5-fb72e7f46ab5 req-6c097c78-d44b-47f9-8323-b301df3bc5b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079662 Aug 31 00:26:05.128745 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 333/651] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:07.290486 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1cb0e37e-bb45-4f7c-bbb8-9cc53fe1968c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:07.291376 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1cb0e37e-bb45-4f7c-bbb8-9cc53fe1968c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:07.301031 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cb0e37e-bb45-4f7c-bbb8-9cc53fe1968c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:07.301717 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cb0e37e-bb45-4f7c-bbb8-9cc53fe1968c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:07.302453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cb0e37e-bb45-4f7c-bbb8-9cc53fe1968c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:07.303347 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cb0e37e-bb45-4f7c-bbb8-9cc53fe1968c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:07.303992 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cb0e37e-bb45-4f7c-bbb8-9cc53fe1968c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:07.304722 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cb0e37e-bb45-4f7c-bbb8-9cc53fe1968c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:07.339876 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1cb0e37e-bb45-4f7c-bbb8-9cc53fe1968c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:26:07.492515 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1cb0e37e-bb45-4f7c-bbb8-9cc53fe1968c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 204 len: 0 microversion: 2.1 time: 0.207803 Aug 31 00:26:07.493559 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 319/652] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:26:07 2022] DELETE /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:26:07.507991 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-709f50a0-dbb9-47a8-a89c-bf16a3daeb8d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:07.509520 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-709f50a0-dbb9-47a8-a89c-bf16a3daeb8d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:07.523737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-709f50a0-dbb9-47a8-a89c-bf16a3daeb8d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:07.524774 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-709f50a0-dbb9-47a8-a89c-bf16a3daeb8d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:07.525912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-709f50a0-dbb9-47a8-a89c-bf16a3daeb8d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:07.527566 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-709f50a0-dbb9-47a8-a89c-bf16a3daeb8d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:07.528957 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-709f50a0-dbb9-47a8-a89c-bf16a3daeb8d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:07.530642 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-709f50a0-dbb9-47a8-a89c-bf16a3daeb8d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:07.772807 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-709f50a0-dbb9-47a8-a89c-bf16a3daeb8d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:07.783339 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-709f50a0-dbb9-47a8-a89c-bf16a3daeb8d tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1506 microversion: 2.1 time: 0.283293 Aug 31 00:26:07.783925 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 334/653] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:07 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:08.829662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1c300365-68e7-4112-983c-dce9e1e709c4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:08.831077 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1c300365-68e7-4112-983c-dce9e1e709c4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:08.845856 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c300365-68e7-4112-983c-dce9e1e709c4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:08.846714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c300365-68e7-4112-983c-dce9e1e709c4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:08.849147 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c300365-68e7-4112-983c-dce9e1e709c4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:08.850366 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c300365-68e7-4112-983c-dce9e1e709c4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:08.851125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c300365-68e7-4112-983c-dce9e1e709c4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:08.851814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1c300365-68e7-4112-983c-dce9e1e709c4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.169715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1c300365-68e7-4112-983c-dce9e1e709c4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:09.189424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1c300365-68e7-4112-983c-dce9e1e709c4 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1506 microversion: 2.1 time: 0.373044 Aug 31 00:26:09.208190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 320/654] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:08 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:10.229918 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b6cb596f-3fd1-4ed5-9e66-fc34481bf03f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:10.232379 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b6cb596f-3fd1-4ed5-9e66-fc34481bf03f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:10.246333 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b6cb596f-3fd1-4ed5-9e66-fc34481bf03f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.247591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b6cb596f-3fd1-4ed5-9e66-fc34481bf03f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.248689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b6cb596f-3fd1-4ed5-9e66-fc34481bf03f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.250224 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b6cb596f-3fd1-4ed5-9e66-fc34481bf03f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.251128 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b6cb596f-3fd1-4ed5-9e66-fc34481bf03f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.251927 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b6cb596f-3fd1-4ed5-9e66-fc34481bf03f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.552971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b6cb596f-3fd1-4ed5-9e66-fc34481bf03f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:10.574724 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b6cb596f-3fd1-4ed5-9e66-fc34481bf03f tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1506 microversion: 2.1 time: 0.353549 Aug 31 00:26:10.577276 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 335/655] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:10 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:11.629416 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:11.633338 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:11.663255 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.664188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.664929 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.666547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.667380 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.674397 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.747934 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-c35aab45-6299-4645-9068-cf108bed7748 req-944f7f65-d08e-4a22-9524-b77eb0f531fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f274203-f40e-4cc4-b0c6-a181fb704311", "name": "network-vif-deleted", "tag": "eadb7db5-44a8-41e0-ac9f-63b1573f5a39"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:11.789034 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-c35aab45-6299-4645-9068-cf108bed7748 req-944f7f65-d08e-4a22-9524-b77eb0f531fa service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.791037 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-c35aab45-6299-4645-9068-cf108bed7748 req-944f7f65-d08e-4a22-9524-b77eb0f531fa service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.791861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-c35aab45-6299-4645-9068-cf108bed7748 req-944f7f65-d08e-4a22-9524-b77eb0f531fa service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.805616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.807524 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.808947 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.810491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lazy-loading 'fault' on Instance uuid 1f274203-f40e-4cc4-b0c6-a181fb704311 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:11.838418 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-c35aab45-6299-4645-9068-cf108bed7748 req-944f7f65-d08e-4a22-9524-b77eb0f531fa service nova] Creating event network-vif-deleted:eadb7db5-44a8-41e0-ac9f-63b1573f5a39 for instance 1f274203-f40e-4cc4-b0c6-a181fb704311 on hv-cinder-85221 Aug 31 00:26:11.863633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-c35aab45-6299-4645-9068-cf108bed7748 req-944f7f65-d08e-4a22-9524-b77eb0f531fa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.555125 Aug 31 00:26:11.865160 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 321/656] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:11.972005 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:11.988140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-805fe742-ed6f-4218-b33a-356baa70d351 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 200 len: 1311 microversion: 2.1 time: 0.377109 Aug 31 00:26:11.995327 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 336/657] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:11 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 1311 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:13.047221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:13.049520 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 1f274203-f40e-4cc4-b0c6-a181fb704311] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:13.059145 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.059882 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.060512 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.061990 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.062544 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.063146 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.082235 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] HTTP exception thrown: Instance 1f274203-f40e-4cc4-b0c6-a181fb704311 could not be found. Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Request method failure captured: Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 HTTP/1.1 Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqlYalK_ZiTauZ-9XDO7haKEIuXnKbHhABMonOFQP-rI78FINZ2XVrTy8p1zk3RjEkVar9pkgMdmtZNVYMAs-uZPoCRzB4Th807o4TLWVOTd_MNqGbppsFiV6_vn3vGaC-JcYOQFNXv-OJkCGApOtlB6lTEq6yiN8b9AAW0Sat2RBB8 Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: af873e6a013c457aa2407fb24423ddc1 Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:26:13.085408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_af873e6a013c457aa2407fb24423ddc1"}]}] Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: af873e6a013c457aa2407fb24423ddc1 Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-ServerRescueNegativeTestJSON-1960179446-project Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: f8ffd2d3c0c141118a7a9a5696c383e1 Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1960179446-project Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance 1f274203-f40e-4cc4-b0c6-a181fb704311 could not be found. Aug 31 00:26:13.088988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '1f274203-f40e-4cc4-b0c6-a181fb704311'} Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f274203-f40e-4cc4-b0c6-a181fb704311 could not be found. Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:26:13.090711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f274203-f40e-4cc4-b0c6-a181fb704311 could not be found. Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f274203-f40e-4cc4-b0c6-a181fb704311 could not be found. Aug 31 00:26:13.093838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:26:13.095971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Returning 404 to user: Instance 1f274203-f40e-4cc4-b0c6-a181fb704311 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:26:13.095971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-eafa3672-9df5-4c97-af5d-024008db1ba1 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311" status: 404 len: 111 microversion: 2.1 time: 0.049048 Aug 31 00:26:13.095971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 322/658] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:13 2022] GET /compute/v2.1/servers/1f274203-f40e-4cc4-b0c6-a181fb704311 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:13.101249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-72e1fa85-c77e-4ba7-9fd5-8e8a31b9586e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:13.102258 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-72e1fa85-c77e-4ba7-9fd5-8e8a31b9586e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:13.116963 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72e1fa85-c77e-4ba7-9fd5-8e8a31b9586e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.125382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72e1fa85-c77e-4ba7-9fd5-8e8a31b9586e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.126714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72e1fa85-c77e-4ba7-9fd5-8e8a31b9586e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.128264 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72e1fa85-c77e-4ba7-9fd5-8e8a31b9586e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.129138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72e1fa85-c77e-4ba7-9fd5-8e8a31b9586e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.129917 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72e1fa85-c77e-4ba7-9fd5-8e8a31b9586e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.169555 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-72e1fa85-c77e-4ba7-9fd5-8e8a31b9586e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Going to try to terminate instance {{(pid=127118) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:26:13.286100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-72e1fa85-c77e-4ba7-9fd5-8e8a31b9586e tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "DELETE /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 204 len: 0 microversion: 2.1 time: 0.190336 Aug 31 00:26:13.287466 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 337/659] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:26:13 2022] DELETE /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:26:13.297305 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e9ff10dd-57e4-48ab-aa9a-31c500c617e2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:13.298199 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e9ff10dd-57e4-48ab-aa9a-31c500c617e2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:13.306391 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9ff10dd-57e4-48ab-aa9a-31c500c617e2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.308417 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9ff10dd-57e4-48ab-aa9a-31c500c617e2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.309338 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9ff10dd-57e4-48ab-aa9a-31c500c617e2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.310698 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9ff10dd-57e4-48ab-aa9a-31c500c617e2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.311548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9ff10dd-57e4-48ab-aa9a-31c500c617e2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.312719 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e9ff10dd-57e4-48ab-aa9a-31c500c617e2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.602391 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e9ff10dd-57e4-48ab-aa9a-31c500c617e2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:13.618088 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e9ff10dd-57e4-48ab-aa9a-31c500c617e2 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.326187 Aug 31 00:26:13.619802 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 323/660] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:13 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:14.642382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5660ff40-baf7-40dd-9c7e-6470f88e5a99 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:14.643384 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5660ff40-baf7-40dd-9c7e-6470f88e5a99 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:14.652619 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5660ff40-baf7-40dd-9c7e-6470f88e5a99 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:14.653315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5660ff40-baf7-40dd-9c7e-6470f88e5a99 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:14.653863 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5660ff40-baf7-40dd-9c7e-6470f88e5a99 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:14.655357 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5660ff40-baf7-40dd-9c7e-6470f88e5a99 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:14.655932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5660ff40-baf7-40dd-9c7e-6470f88e5a99 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:14.656698 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5660ff40-baf7-40dd-9c7e-6470f88e5a99 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:14.896784 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5660ff40-baf7-40dd-9c7e-6470f88e5a99 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:14.907113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5660ff40-baf7-40dd-9c7e-6470f88e5a99 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.270468 Aug 31 00:26:14.921301 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 338/661] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:14 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:15.930141 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b7f8ac41-25d3-4ff3-be3d-f2e7d6670e12 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:15.930819 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b7f8ac41-25d3-4ff3-be3d-f2e7d6670e12 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:15.938854 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac41-25d3-4ff3-be3d-f2e7d6670e12 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:15.939359 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac41-25d3-4ff3-be3d-f2e7d6670e12 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:15.939802 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac41-25d3-4ff3-be3d-f2e7d6670e12 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:15.940578 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac41-25d3-4ff3-be3d-f2e7d6670e12 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:15.941056 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac41-25d3-4ff3-be3d-f2e7d6670e12 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:15.941481 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac41-25d3-4ff3-be3d-f2e7d6670e12 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:16.250272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b7f8ac41-25d3-4ff3-be3d-f2e7d6670e12 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:16.262231 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b7f8ac41-25d3-4ff3-be3d-f2e7d6670e12 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.335973 Aug 31 00:26:16.262907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 324/662] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:15 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:17.289269 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-cc673599-ff7c-4440-877c-697cc39ee84a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:17.291625 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-cc673599-ff7c-4440-877c-697cc39ee84a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:17.306451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cc673599-ff7c-4440-877c-697cc39ee84a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:17.308090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cc673599-ff7c-4440-877c-697cc39ee84a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:17.309318 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cc673599-ff7c-4440-877c-697cc39ee84a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:17.311649 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cc673599-ff7c-4440-877c-697cc39ee84a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:17.312795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cc673599-ff7c-4440-877c-697cc39ee84a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:17.314067 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cc673599-ff7c-4440-877c-697cc39ee84a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:17.857208 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-cc673599-ff7c-4440-877c-697cc39ee84a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:17.876093 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-cc673599-ff7c-4440-877c-697cc39ee84a tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1519 microversion: 2.1 time: 0.595453 Aug 31 00:26:17.898692 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 339/663] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:17 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1519 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:18.915982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b695091d-4038-4692-8260-aaa1dfd6201c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:18.917206 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b695091d-4038-4692-8260-aaa1dfd6201c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:18.949347 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b695091d-4038-4692-8260-aaa1dfd6201c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:18.950308 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b695091d-4038-4692-8260-aaa1dfd6201c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:18.951063 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b695091d-4038-4692-8260-aaa1dfd6201c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:18.952042 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b695091d-4038-4692-8260-aaa1dfd6201c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:18.952800 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b695091d-4038-4692-8260-aaa1dfd6201c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:18.953516 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b695091d-4038-4692-8260-aaa1dfd6201c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:19.011643 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-41327f17-06fe-467f-80fe-8b334517ee78 req-3beea9c8-4087-4200-9a8c-98c9c9ff58c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379d25b6-01b5-4bed-ba25-2f169d66600b", "name": "network-vif-deleted", "tag": "b667fe99-0903-42b3-8838-53300f0a504b"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:19.046148 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-41327f17-06fe-467f-80fe-8b334517ee78 req-3beea9c8-4087-4200-9a8c-98c9c9ff58c7 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:19.047078 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-41327f17-06fe-467f-80fe-8b334517ee78 req-3beea9c8-4087-4200-9a8c-98c9c9ff58c7 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:19.051672 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-41327f17-06fe-467f-80fe-8b334517ee78 req-3beea9c8-4087-4200-9a8c-98c9c9ff58c7 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:19.076423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-41327f17-06fe-467f-80fe-8b334517ee78 req-3beea9c8-4087-4200-9a8c-98c9c9ff58c7 service nova] Creating event network-vif-deleted:b667fe99-0903-42b3-8838-53300f0a504b for instance 379d25b6-01b5-4bed-ba25-2f169d66600b on hv-cinder-85221 Aug 31 00:26:19.086203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-41327f17-06fe-467f-80fe-8b334517ee78 req-3beea9c8-4087-4200-9a8c-98c9c9ff58c7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081067 Aug 31 00:26:19.087432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 340/664] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:19.134898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b695091d-4038-4692-8260-aaa1dfd6201c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:19.155437 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b695091d-4038-4692-8260-aaa1dfd6201c tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1477 microversion: 2.1 time: 0.246879 Aug 31 00:26:19.164924 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 325/665] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:18 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1477 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:20.185556 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-bfd9795b-41d6-4e5f-a7c2-820d06927fc2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Action: 'create', calling method: .version_select at 0x7f1a3a92bf70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1127305482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3ZYUdvhM5O6YKH9d217BOs6YmY/ZTRFvxpPn1VdljT47kMSqcORSwkC3a2+arFYTHMhMFEUplu8NrMiScJG/7VVl4QFLPOUihVFN/Nu5H4Kklisl0O4kSzlXdsFgI7sg=="}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:20.198724 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:20.199462 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:20.214123 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:20.214733 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:20.215183 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:20.215939 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:20.216430 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:20.216858 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:20.226247 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-bfd9795b-41d6-4e5f-a7c2-820d06927fc2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Getting quotas for project 5e59b45c75cb4f8ea7e7a47730709614. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:26:20.236720 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-bfd9795b-41d6-4e5f-a7c2-820d06927fc2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Getting quotas for user 410f2e9dc2db4ffcb5ff0f67b0d00ddc and project 5e59b45c75cb4f8ea7e7a47730709614. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:26:20.281702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-bfd9795b-41d6-4e5f-a7c2-820d06927fc2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.387664 Aug 31 00:26:20.285527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 341/666] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 31 00:26:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:26:20.310152 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:20.312218 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:20.313234 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:20.314205 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lazy-loading 'fault' on Instance uuid 379d25b6-01b5-4bed-ba25-2f169d66600b {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:20.400769 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ffd2d3c0c141118a7a9a5696c383e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af873e6a013c457aa2407fb24423ddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:20.417549 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-46fbc780-468d-44d8-a622-1ce45b9d48ac tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 200 len: 1310 microversion: 2.1 time: 0.231570 Aug 31 00:26:20.419176 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 326/667] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:20 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 1310 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:21.456411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:21.460516 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] [instance: 379d25b6-01b5-4bed-ba25-2f169d66600b] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:21.471732 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:21.472207 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:21.476141 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:21.477112 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:21.478098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:21.478801 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:21.496530 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] HTTP exception thrown: Instance 379d25b6-01b5-4bed-ba25-2f169d66600b could not be found. Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Request method failure captured: Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b HTTP/1.1 Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYalK_ZiTauZ-9XDO7haKEIuXnKbHhABMonOFQP-rI78FINZ2XVrTy8p1zk3RjEkVar9pkgMdmtZNVYMAs-uZPoCRzB4Th807o4TLWVOTd_MNqGbppsFiV6_vn3vGaC-JcYOQFNXv-OJkCGApOtlB6lTEq6yiN8b9AAW0Sat2RBB8 Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: af873e6a013c457aa2407fb24423ddc1 Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:26:21.499693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af873e6a013c457aa2407fb24423ddc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_af873e6a013c457aa2407fb24423ddc1"}]}] Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: af873e6a013c457aa2407fb24423ddc1 Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1960179446 Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-ServerRescueNegativeTestJSON-1960179446-project Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: f8ffd2d3c0c141118a7a9a5696c383e1 Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1960179446-project Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 379d25b6-01b5-4bed-ba25-2f169d66600b could not be found. Aug 31 00:26:21.502727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '379d25b6-01b5-4bed-ba25-2f169d66600b'} Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 379d25b6-01b5-4bed-ba25-2f169d66600b could not be found. Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:26:21.504546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 379d25b6-01b5-4bed-ba25-2f169d66600b could not be found. Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 379d25b6-01b5-4bed-ba25-2f169d66600b could not be found. Aug 31 00:26:21.507313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:21.511971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] Returning 404 to user: Instance 379d25b6-01b5-4bed-ba25-2f169d66600b could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:26:21.511971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d85395d4-d065-4b50-99bf-9471283986c9 tempest-ServerRescueNegativeTestJSON-1960179446 tempest-ServerRescueNegativeTestJSON-1960179446-project] 10.222.0.47 "GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b" status: 404 len: 111 microversion: 2.1 time: 0.053808 Aug 31 00:26:21.511971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 342/668] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:21 2022] GET /compute/v2.1/servers/379d25b6-01b5-4bed-ba25-2f169d66600b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:26:25.293083 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b1c284e6-3d83-4332-8b81-d9385073234f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:25.293797 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b1c284e6-3d83-4332-8b81-d9385073234f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:25.301977 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b1c284e6-3d83-4332-8b81-d9385073234f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:25.302637 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b1c284e6-3d83-4332-8b81-d9385073234f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:25.303084 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b1c284e6-3d83-4332-8b81-d9385073234f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:25.303858 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b1c284e6-3d83-4332-8b81-d9385073234f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:25.304372 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b1c284e6-3d83-4332-8b81-d9385073234f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:25.304951 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b1c284e6-3d83-4332-8b81-d9385073234f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:25.359696 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b1c284e6-3d83-4332-8b81-d9385073234f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/ips" status: 200 len: 151 microversion: 2.1 time: 0.232505 Aug 31 00:26:25.361687 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 327/669] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 31 00:26:25 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/ips => generated 151 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:27.033438 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-11cec0e6-df7a-47c3-901e-6aee1df9e9f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1713d2f9-d6f9-4e05-b527-ab8a54c67809"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:27.038945 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-11cec0e6-df7a-47c3-901e-6aee1df9e9f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:27.062349 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11cec0e6-df7a-47c3-901e-6aee1df9e9f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:27.062929 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11cec0e6-df7a-47c3-901e-6aee1df9e9f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:27.063811 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11cec0e6-df7a-47c3-901e-6aee1df9e9f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:27.065279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11cec0e6-df7a-47c3-901e-6aee1df9e9f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:27.066268 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11cec0e6-df7a-47c3-901e-6aee1df9e9f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:27.067131 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-11cec0e6-df7a-47c3-901e-6aee1df9e9f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:27.666130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-11cec0e6-df7a-47c3-901e-6aee1df9e9f5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.640267 Aug 31 00:26:27.668531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 343/670] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:26:27 2022] POST /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:30.793906 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-0beb47fc-2ecc-4b5d-826e-dec73a07e320 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] Calling method '.version_select at 0x7f1a3a8b4ca0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:30.854738 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-0beb47fc-2ecc-4b5d-826e-dec73a07e320 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c2891331-80c3-48aa-8066-d34a26923787" status: 200 len: 351 microversion: 2.1 time: 0.067906 Aug 31 00:26:30.855496 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 328/671] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:26:30 2022] GET /compute/v2.1/os-volumes/c2891331-80c3-48aa-8066-d34a26923787 => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:32.299749 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=4 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:32.307292 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-61c37366-8906-4de5-9feb-475d32bfc6fb tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] Calling method '.version_select at 0x7f1a3a843ca0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:32.368398 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-61c37366-8906-4de5-9feb-475d32bfc6fb tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ea26e9a9-887c-4090-b95d-4c108a333694" status: 200 len: 350 microversion: 2.1 time: 0.071018 Aug 31 00:26:32.369019 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 344/672] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:26:32 2022] GET /compute/v2.1/os-volumes/ea26e9a9-887c-4090-b95d-4c108a333694 => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:33.810563 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6c7cc5f1-a3b6-4416-8665-4659f3058279 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] Calling method '.version_select at 0x7f1a3a97d8b0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:33.866941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6c7cc5f1-a3b6-4416-8665-4659f3058279 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/2fec7eaf-1c13-490c-80f0-8d0f0b1f8b97" status: 200 len: 351 microversion: 2.1 time: 0.061127 Aug 31 00:26:33.867873 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 329/673] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:26:33 2022] GET /compute/v2.1/os-volumes/2fec7eaf-1c13-490c-80f0-8d0f0b1f8b97 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:33.883078 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-47b9befa-c1c0-4889-86ee-45c6538aa6c0 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] Calling method '.version_select at 0x7f1a3a7fdc10>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:33.980429 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-47b9befa-c1c0-4889-86ee-45c6538aa6c0 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.101581 Aug 31 00:26:33.981033 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 345/674] 10.222.0.47 () {58 vars in 1134 bytes} [Wed Aug 31 00:26:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:33.999299 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-04e4681b-6fc5-48c8-9eae-f9ae1a56e761 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] Calling method '.version_select at 0x7f1a3a9bd8b0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:34.103873 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-04e4681b-6fc5-48c8-9eae-f9ae1a56e761 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.110880 Aug 31 00:26:34.104588 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 330/675] 10.222.0.47 () {58 vars in 1149 bytes} [Wed Aug 31 00:26:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:34.124466 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9bb07895-d5d5-436b-8c54-acd351ee75e6 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] Calling method '.version_select at 0x7f1a3a7fdaf0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:34.226471 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9bb07895-d5d5-436b-8c54-acd351ee75e6 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.106338 Aug 31 00:26:34.227479 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 346/676] 10.222.0.47 () {58 vars in 1134 bytes} [Wed Aug 31 00:26:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:34.246865 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a5a229e1-27ef-4a9a-9dd9-489323fa0f30 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] Calling method '.version_select at 0x7f1a3a992d30>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:34.345746 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a5a229e1-27ef-4a9a-9dd9-489323fa0f30 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.102887 Aug 31 00:26:34.346317 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 331/677] 10.222.0.47 () {58 vars in 1167 bytes} [Wed Aug 31 00:26:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:34.360826 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f7ff5c6f-ea18-4cc9-8b07-baf69ce53a98 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] Calling method '.version_select at 0x7f1a3a852ca0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:34.456808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f7ff5c6f-ea18-4cc9-8b07-baf69ce53a98 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.100657 Aug 31 00:26:34.457487 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 347/678] 10.222.0.47 () {58 vars in 1170 bytes} [Wed Aug 31 00:26:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:34.475790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5d669f03-a1d2-4046-a967-61e06d881e5b tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] Calling method '.version_select at 0x7f1a3a96dd30>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:34.572400 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5d669f03-a1d2-4046-a967-61e06d881e5b tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.103130 Aug 31 00:26:34.573171 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 332/679] 10.222.0.47 () {58 vars in 1155 bytes} [Wed Aug 31 00:26:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:34.587954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-506354fe-5099-4693-b296-22b5821d4e00 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] Calling method '.version_select at 0x7f1a3a7eac10>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:34.862766 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-506354fe-5099-4693-b296-22b5821d4e00 tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.278684 Aug 31 00:26:34.863350 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 348/680] 10.222.0.47 () {58 vars in 1188 bytes} [Wed Aug 31 00:26:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:26:34.884424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-32c23b6d-9834-4332-bd06-2d00a2bb013f tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] Calling method '.version_select at 0x7f1a3a8ef8b0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:34.991107 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-32c23b6d-9834-4332-bd06-2d00a2bb013f tempest-VolumesTestJSON-706652186 tempest-VolumesTestJSON-706652186-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.118110 Aug 31 00:26:34.991754 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 333/681] 10.222.0.47 () {58 vars in 1155 bytes} [Wed Aug 31 00:26:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:35.412222 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1713d2f9-d6f9-4e05-b527-ab8a54c67809"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:35.414799 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:35.421701 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.422189 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.422628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.423953 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.423953 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.424226 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.427269 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:35.526251 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Invalid volume: volume 1713d2f9-d6f9-4e05-b527-ab8a54c67809 is already attached to instances: 599f96bf-1137-4129-af25-5d61b32a4349 Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: POST /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-volume_attachments HTTP/1.1 Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 74 Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:26:35.528572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {"volumeAttachment": {"volumeId": "1713d2f9-d6f9-4e05-b527-ab8a54c67809"}} Aug 31 00:26:35.531209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Invalid volume: volume 1713d2f9-d6f9-4e05-b527-ab8a54c67809 is already attached to instances: 599f96bf-1137-4129-af25-5d61b32a4349 Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'server_id': '599f96bf-1137-4129-af25-5d61b32a4349', 'body': {'volumeAttachment': {'volumeId': '1713d2f9-d6f9-4e05-b527-ab8a54c67809'}}} Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1713d2f9-d6f9-4e05-b527-ab8a54c67809 is already attached to instances: 599f96bf-1137-4129-af25-5d61b32a4349 Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:35.532199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1713d2f9-d6f9-4e05-b527-ab8a54c67809 is already attached to instances: 599f96bf-1137-4129-af25-5d61b32a4349 Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:35.533736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:35.535114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:35.535114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:26:35.535114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:26:35.535114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1713d2f9-d6f9-4e05-b527-ab8a54c67809 is already attached to instances: 599f96bf-1137-4129-af25-5d61b32a4349 Aug 31 00:26:35.535114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:35.535114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 400 to user: Invalid volume: volume 1713d2f9-d6f9-4e05-b527-ab8a54c67809 is already attached to instances: 599f96bf-1137-4129-af25-5d61b32a4349 {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:26:35.535114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d6277a2a-3122-4174-ad3b-d48a4c7da00c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127963 Aug 31 00:26:35.535114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 349/682] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:26:35 2022] POST /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:26:35.608691 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:35.610068 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:35.614189 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9d55c7af-789c-48cf-b73c-a37231f66950 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:35.614684 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9d55c7af-789c-48cf-b73c-a37231f66950 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:35.625453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d55c7af-789c-48cf-b73c-a37231f66950 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.626172 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d55c7af-789c-48cf-b73c-a37231f66950 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.626885 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d55c7af-789c-48cf-b73c-a37231f66950 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.627863 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d55c7af-789c-48cf-b73c-a37231f66950 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.628673 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d55c7af-789c-48cf-b73c-a37231f66950 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.629288 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d55c7af-789c-48cf-b73c-a37231f66950 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.777096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-9d55c7af-789c-48cf-b73c-a37231f66950 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lazy-loading 'services' on Instance uuid 599f96bf-1137-4129-af25-5d61b32a4349 {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:35.919509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9d55c7af-789c-48cf-b73c-a37231f66950 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-volume_attachments/1713d2f9-d6f9-4e05-b527-ab8a54c67809" status: 202 len: 0 microversion: 2.1 time: 0.313031 Aug 31 00:26:35.920545 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 334/683] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:26:35 2022] DELETE /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-volume_attachments/1713d2f9-d6f9-4e05-b527-ab8a54c67809 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:26:35.929036 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c6f3a327-a0b3-4b82-82b0-4506d15b2ae3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:35.936357 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c6f3a327-a0b3-4b82-82b0-4506d15b2ae3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:35.947406 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c6f3a327-a0b3-4b82-82b0-4506d15b2ae3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.948253 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c6f3a327-a0b3-4b82-82b0-4506d15b2ae3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.948774 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c6f3a327-a0b3-4b82-82b0-4506d15b2ae3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.949554 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c6f3a327-a0b3-4b82-82b0-4506d15b2ae3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.950071 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c6f3a327-a0b3-4b82-82b0-4506d15b2ae3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.950629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c6f3a327-a0b3-4b82-82b0-4506d15b2ae3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.989598 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c6f3a327-a0b3-4b82-82b0-4506d15b2ae3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064558 Aug 31 00:26:35.990301 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 350/684] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:26:35 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:26:37.008908 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-078b6542-c07d-4c08-abca-ea9facbbc983 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:37.011284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-078b6542-c07d-4c08-abca-ea9facbbc983 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:37.020642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-078b6542-c07d-4c08-abca-ea9facbbc983 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.021148 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-078b6542-c07d-4c08-abca-ea9facbbc983 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.021596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-078b6542-c07d-4c08-abca-ea9facbbc983 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.022339 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-078b6542-c07d-4c08-abca-ea9facbbc983 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.022892 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-078b6542-c07d-4c08-abca-ea9facbbc983 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.023579 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-078b6542-c07d-4c08-abca-ea9facbbc983 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.063945 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-078b6542-c07d-4c08-abca-ea9facbbc983 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060458 Aug 31 00:26:37.064558 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 335/685] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:26:37 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:26:37.144657 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e51c377d-ee43-4c35-8832-515ac047a021 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:37.145315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e51c377d-ee43-4c35-8832-515ac047a021 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:37.153658 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e51c377d-ee43-4c35-8832-515ac047a021 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.153658 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e51c377d-ee43-4c35-8832-515ac047a021 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.153658 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e51c377d-ee43-4c35-8832-515ac047a021 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.155400 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e51c377d-ee43-4c35-8832-515ac047a021 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.155869 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e51c377d-ee43-4c35-8832-515ac047a021 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.156513 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e51c377d-ee43-4c35-8832-515ac047a021 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.187180 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e51c377d-ee43-4c35-8832-515ac047a021 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Going to try to terminate instance {{(pid=127118) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:26:37.279337 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e51c377d-ee43-4c35-8832-515ac047a021 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 204 len: 0 microversion: 2.1 time: 0.140227 Aug 31 00:26:37.280407 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 351/686] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:26:37 2022] DELETE /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:26:37.290602 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-14153285-4c4c-4391-9051-a2fcc4ee93a0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:37.291235 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-14153285-4c4c-4391-9051-a2fcc4ee93a0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:37.300395 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-14153285-4c4c-4391-9051-a2fcc4ee93a0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.300395 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-14153285-4c4c-4391-9051-a2fcc4ee93a0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.300836 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-14153285-4c4c-4391-9051-a2fcc4ee93a0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.301566 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-14153285-4c4c-4391-9051-a2fcc4ee93a0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.302027 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-14153285-4c4c-4391-9051-a2fcc4ee93a0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.302458 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-14153285-4c4c-4391-9051-a2fcc4ee93a0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.511810 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-14153285-4c4c-4391-9051-a2fcc4ee93a0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:37.526958 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-14153285-4c4c-4391-9051-a2fcc4ee93a0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1680 microversion: 2.1 time: 0.240495 Aug 31 00:26:37.527999 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 336/687] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:37 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:38.564968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b97d5c67-610c-48c8-92c1-5bf2a0cdc233 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:38.566117 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b97d5c67-610c-48c8-92c1-5bf2a0cdc233 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:38.569996 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:38.577602 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b97d5c67-610c-48c8-92c1-5bf2a0cdc233 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:38.578097 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b97d5c67-610c-48c8-92c1-5bf2a0cdc233 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:38.578539 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b97d5c67-610c-48c8-92c1-5bf2a0cdc233 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:38.579267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b97d5c67-610c-48c8-92c1-5bf2a0cdc233 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:38.579745 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b97d5c67-610c-48c8-92c1-5bf2a0cdc233 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:38.580208 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b97d5c67-610c-48c8-92c1-5bf2a0cdc233 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:38.775325 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b97d5c67-610c-48c8-92c1-5bf2a0cdc233 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:38.784959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b97d5c67-610c-48c8-92c1-5bf2a0cdc233 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1680 microversion: 2.1 time: 0.226038 Aug 31 00:26:38.785451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 352/688] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:38 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:39.826932 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d3b17eb0-49e7-4374-84f1-2f7995af2db5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:39.827536 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d3b17eb0-49e7-4374-84f1-2f7995af2db5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:39.839988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3b17eb0-49e7-4374-84f1-2f7995af2db5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:39.843102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3b17eb0-49e7-4374-84f1-2f7995af2db5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:39.843584 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3b17eb0-49e7-4374-84f1-2f7995af2db5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:39.844380 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3b17eb0-49e7-4374-84f1-2f7995af2db5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:39.844843 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3b17eb0-49e7-4374-84f1-2f7995af2db5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:39.845269 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3b17eb0-49e7-4374-84f1-2f7995af2db5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:40.188362 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d3b17eb0-49e7-4374-84f1-2f7995af2db5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:40.198201 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d3b17eb0-49e7-4374-84f1-2f7995af2db5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1680 microversion: 2.1 time: 0.375842 Aug 31 00:26:40.199004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 337/689] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:39 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1680 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:40.212404 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1183746284", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1127305482", "security_groups": [{"name": "tempest-secgroup-smoke-835580744"}], "block_device_mapping_v2": [{"uuid": "3f5ea833-e8aa-4ad3-b067-b30ee8ca95e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2cf33b5d-0191-49b5-9f4e-a777ce59af25"}]}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:40.565061 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.network.neutron [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] validate_networks() for [('2cf33b5d-0191-49b5-9f4e-a777ce59af25', None, None, None, None, None)] {{(pid=127118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:26:41.052425 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-9affcfce-eea1-4b3a-9e62-bb973431be6e req-284d08ae-9e63-4345-9a6a-9a9f58338e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599f96bf-1137-4129-af25-5d61b32a4349", "name": "network-vif-deleted", "tag": "e3547217-2be7-4db4-b82d-59dc6f1654fc"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:41.081409 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-9affcfce-eea1-4b3a-9e62-bb973431be6e req-284d08ae-9e63-4345-9a6a-9a9f58338e0d service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:41.082365 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-9affcfce-eea1-4b3a-9e62-bb973431be6e req-284d08ae-9e63-4345-9a6a-9a9f58338e0d service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:41.082995 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-9affcfce-eea1-4b3a-9e62-bb973431be6e req-284d08ae-9e63-4345-9a6a-9a9f58338e0d service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:41.097768 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-9affcfce-eea1-4b3a-9e62-bb973431be6e req-284d08ae-9e63-4345-9a6a-9a9f58338e0d service nova] Creating event network-vif-deleted:e3547217-2be7-4db4-b82d-59dc6f1654fc for instance 599f96bf-1137-4129-af25-5d61b32a4349 on hv-cinder-85221 Aug 31 00:26:41.113059 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-9affcfce-eea1-4b3a-9e62-bb973431be6e req-284d08ae-9e63-4345-9a6a-9a9f58338e0d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068574 Aug 31 00:26:41.115376 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 338/690] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:26:41.234943 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:41.235858 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:41.243256 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:41.243859 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:41.244407 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:41.245433 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:41.246203 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:41.247059 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:41.288282 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:41.289371 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:41.290100 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:41.290905 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lazy-loading 'fault' on Instance uuid 599f96bf-1137-4129-af25-5d61b32a4349 {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:41.393694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:41.411933 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cf9cbe4b-9a04-4db0-8d07-934fc96fc026 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 200 len: 1328 microversion: 2.1 time: 0.181928 Aug 31 00:26:41.413826 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 339/691] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:41 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 1328 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:41.680595 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Flavor limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:26:41.681389 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Image limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:26:41.681952 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Flavor pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:26:41.683178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Image pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:26:41.700228 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-026f46b0-0b1c-4680-9904-692989e6d0b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:41.701813 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:26:41.705363 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-026f46b0-0b1c-4680-9904-692989e6d0b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:41.729081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-026f46b0-0b1c-4680-9904-692989e6d0b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:41.730076 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-026f46b0-0b1c-4680-9904-692989e6d0b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:41.730867 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-026f46b0-0b1c-4680-9904-692989e6d0b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:41.732326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-026f46b0-0b1c-4680-9904-692989e6d0b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:41.733216 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-026f46b0-0b1c-4680-9904-692989e6d0b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:41.734043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-026f46b0-0b1c-4680-9904-692989e6d0b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:41.741713 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:41.742465 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:41.743274 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:41.745135 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:41.745881 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:41.746637 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:41.788607 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Getting quotas for project 5e59b45c75cb4f8ea7e7a47730709614. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:26:41.803785 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Getting quotas for user 410f2e9dc2db4ffcb5ff0f67b0d00ddc and project 5e59b45c75cb4f8ea7e7a47730709614. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:26:41.860547 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-026f46b0-0b1c-4680-9904-692989e6d0b0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/ips" status: 200 len: 151 microversion: 2.20 time: 0.170404 Aug 31 00:26:41.861965 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 340/692] 10.222.0.47 () {60 vars in 1289 bytes} [Wed Aug 31 00:26:41 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/ips => generated 151 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:26:42.010266 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Going to run 1 instances... {{(pid=127118) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:26:42.019580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f5ea833-e8aa-4ad3-b067-b30ee8ca95e9',volume_size=None,volume_type=None)] {{(pid=127118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:26:42.291016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-108312c6-cd6f-48e1-a634-fea62eddd952 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.101978 Aug 31 00:26:42.292107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 353/693] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:26:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:26:42.316932 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c66e0a71-2a7c-49e8-b51c-6a958f65bafa tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:42.320080 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c66e0a71-2a7c-49e8-b51c-6a958f65bafa tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:42.471385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c66e0a71-2a7c-49e8-b51c-6a958f65bafa tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:42.479342 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:42.483505 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:42.514103 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c66e0a71-2a7c-49e8-b51c-6a958f65bafa tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1095 microversion: 2.1 time: 0.204360 Aug 31 00:26:42.515316 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 341/694] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:42 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1095 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:42.541590 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:42.542466 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:42.543126 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:42.551049 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:42.552603 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:42.553717 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:42.593748 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 HTTP/1.1 Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:26:42.597791 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:26:42.599161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '599f96bf-1137-4129-af25-5d61b32a4349'} Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:26:42.599915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:26:42.601249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:26:42.602411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:26:42.602411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d1f4fe12-876e-4f4a-bbb4-bdd3483ceecc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 404 len: 111 microversion: 2.1 time: 0.140053 Aug 31 00:26:42.609423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 354/695] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:42 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:42.619858 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d797d622-aa8d-4440-ab3b-3a3ffa42de47 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '.version_select at 0x7f1a3a96dd30>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:42.673669 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d797d622-aa8d-4440-ab3b-3a3ffa42de47 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-8222539" status: 202 len: 0 microversion: 2.1 time: 0.061267 Aug 31 00:26:42.675148 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 342/696] 10.222.0.47 () {58 vars in 1212 bytes} [Wed Aug 31 00:26:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-8222539 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:26:43.564036 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-549a4eee-bef4-4159-9c84-558ea5d8b0eb tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:43.565340 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-549a4eee-bef4-4159-9c84-558ea5d8b0eb tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:43.623958 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-549a4eee-bef4-4159-9c84-558ea5d8b0eb tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:43.624534 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-549a4eee-bef4-4159-9c84-558ea5d8b0eb tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:43.625111 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-549a4eee-bef4-4159-9c84-558ea5d8b0eb tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:43.629649 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-549a4eee-bef4-4159-9c84-558ea5d8b0eb tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:43.630961 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-549a4eee-bef4-4159-9c84-558ea5d8b0eb tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:43.632054 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-549a4eee-bef4-4159-9c84-558ea5d8b0eb tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:43.865136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-549a4eee-bef4-4159-9c84-558ea5d8b0eb tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:43.889552 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-549a4eee-bef4-4159-9c84-558ea5d8b0eb tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1137 microversion: 2.1 time: 0.332334 Aug 31 00:26:43.891946 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 355/697] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:43 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1137 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:44.123721 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-59819f43-1b33-4777-b849-69d2949c90bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:44.125841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-59819f43-1b33-4777-b849-69d2949c90bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:44.140746 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59819f43-1b33-4777-b849-69d2949c90bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:44.141571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59819f43-1b33-4777-b849-69d2949c90bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:44.142366 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59819f43-1b33-4777-b849-69d2949c90bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:44.148575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59819f43-1b33-4777-b849-69d2949c90bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:44.148575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59819f43-1b33-4777-b849-69d2949c90bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:44.148575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59819f43-1b33-4777-b849-69d2949c90bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:44.170080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-6cf183b3-1d95-41c5-b5ed-812bfdcfdd87 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: .version_select at 0x7f1a3aaa51f0>, body: {"keypair": {"name": "tempest-keypair-134613055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2vszgMkLBzg8m3KWxmhw1FtcQu1VgJhpx4zY0mS9a8OPcRbgIe3ehFeSwKl5p9lEEBGZGYmzggCq3b7BlyQct7f/F8yo6gFDRRem9Nn+7ymTgsXGMj0eXlv8nZZbHb5g=="}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:44.196062 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-6cf183b3-1d95-41c5-b5ed-812bfdcfdd87 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:26:44.207707 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-59819f43-1b33-4777-b849-69d2949c90bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lazy-loading 'flavor' on Instance uuid 698d47ed-0a7a-4601-87a9-beb0597d3045 {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:44.224472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-6cf183b3-1d95-41c5-b5ed-812bfdcfdd87 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for user b3da9d7af0fd4c1d99973e6b277b16d2 and project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'key_pairs'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:26:44.285230 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-6cf183b3-1d95-41c5-b5ed-812bfdcfdd87 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118599 Aug 31 00:26:44.289921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 356/698] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 31 00:26:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:26:44.529952 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-59819f43-1b33-4777-b849-69d2949c90bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "POST /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/action" status: 202 len: 0 microversion: 2.20 time: 0.413321 Aug 31 00:26:44.547284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 343/699] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 31 00:26:44 2022] POST /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:26:44.573746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:44.578696 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:44.618132 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:44.621691 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:44.625033 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:44.627339 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:44.629283 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:44.631998 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:44.917126 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8a866361-425b-4874-b110-fbc485edd348 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:44.918267 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8a866361-425b-4874-b110-fbc485edd348 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:44.926197 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8a866361-425b-4874-b110-fbc485edd348 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:44.926991 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8a866361-425b-4874-b110-fbc485edd348 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:44.927663 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8a866361-425b-4874-b110-fbc485edd348 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:44.928698 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8a866361-425b-4874-b110-fbc485edd348 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:44.929233 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8a866361-425b-4874-b110-fbc485edd348 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:44.929729 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8a866361-425b-4874-b110-fbc485edd348 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:45.159686 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8a866361-425b-4874-b110-fbc485edd348 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:45.187252 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8a866361-425b-4874-b110-fbc485edd348 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1211 microversion: 2.1 time: 0.272990 Aug 31 00:26:45.204196 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 344/700] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:44 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1211 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:45.219660 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:45.229836 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:45.231545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:45.233675 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-71003261-8e85-496c-a7fa-e05c4b7ea395 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.679781 Aug 31 00:26:45.242964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 357/701] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:44 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:46.229082 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d4a0ba22-de0e-44e4-8633-b99436b41f3f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:46.231449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d4a0ba22-de0e-44e4-8633-b99436b41f3f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:46.246890 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4a0ba22-de0e-44e4-8633-b99436b41f3f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:46.248739 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4a0ba22-de0e-44e4-8633-b99436b41f3f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:46.249969 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4a0ba22-de0e-44e4-8633-b99436b41f3f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:46.251744 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4a0ba22-de0e-44e4-8633-b99436b41f3f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:46.253177 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4a0ba22-de0e-44e4-8633-b99436b41f3f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:46.255004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d4a0ba22-de0e-44e4-8633-b99436b41f3f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:46.262763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:46.269610 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:46.282128 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:46.283159 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:46.284127 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:46.285422 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:46.286183 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:46.287221 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:46.426422 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d4a0ba22-de0e-44e4-8633-b99436b41f3f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:46.443281 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d4a0ba22-de0e-44e4-8633-b99436b41f3f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1199 microversion: 2.1 time: 0.221745 Aug 31 00:26:46.444813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 345/702] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:46 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1199 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:46.791110 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:46.810774 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:46.817099 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:46.819746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0095d14f-3acc-40e2-8036-a0978ace3c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.564479 Aug 31 00:26:46.822687 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 358/703] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:46 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:47.481512 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-64240934-a3f3-48bf-b8ce-7a426a737761 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:47.483742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-64240934-a3f3-48bf-b8ce-7a426a737761 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:47.496118 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64240934-a3f3-48bf-b8ce-7a426a737761 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:47.497311 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64240934-a3f3-48bf-b8ce-7a426a737761 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:47.498123 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64240934-a3f3-48bf-b8ce-7a426a737761 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:47.499329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64240934-a3f3-48bf-b8ce-7a426a737761 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:47.499939 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64240934-a3f3-48bf-b8ce-7a426a737761 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:47.500629 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64240934-a3f3-48bf-b8ce-7a426a737761 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:47.853974 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:47.856603 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:47.867192 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:47.868480 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:47.869615 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:47.871313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:47.873652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:47.874924 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:48.009807 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-64240934-a3f3-48bf-b8ce-7a426a737761 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:48.027711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-64240934-a3f3-48bf-b8ce-7a426a737761 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1266 microversion: 2.1 time: 0.552026 Aug 31 00:26:48.032733 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 346/704] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:47 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1266 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:48.316649 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:48.334111 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:48.338082 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:48.340593 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a7e493f8-c2f3-4501-bf84-854714299c7d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.495313 Aug 31 00:26:48.342063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 359/705] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:47 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:48.673943 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-494779787", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "923db031-4095-45ac-869f-da21aba3a797"}], "security_groups": [{"name": "tempest-securitygroup--922734637"}], "key_name": "tempest-keypair-134613055", "user_data": "}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:48.823558 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-648dafe4-673f-4ecc-a703-a87bb663bbb1 req-e25d4ad6-8509-436d-be89-3f9f73302e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f5b45e-d0c7-461b-addb-c046c9cce995", "tag": "7ee0bda6-a8f6-49b1-b97f-b289c4493bf3"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:48.850381 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-648dafe4-673f-4ecc-a703-a87bb663bbb1 req-e25d4ad6-8509-436d-be89-3f9f73302e34 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:48.851296 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-648dafe4-673f-4ecc-a703-a87bb663bbb1 req-e25d4ad6-8509-436d-be89-3f9f73302e34 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:48.851693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-648dafe4-673f-4ecc-a703-a87bb663bbb1 req-e25d4ad6-8509-436d-be89-3f9f73302e34 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:48.871998 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-648dafe4-673f-4ecc-a703-a87bb663bbb1 req-e25d4ad6-8509-436d-be89-3f9f73302e34 service nova] Creating event network-changed:7ee0bda6-a8f6-49b1-b97f-b289c4493bf3 for instance b3f5b45e-d0c7-461b-addb-c046c9cce995 on hv-cinder-85221 Aug 31 00:26:48.879150 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-648dafe4-673f-4ecc-a703-a87bb663bbb1 req-e25d4ad6-8509-436d-be89-3f9f73302e34 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063972 Aug 31 00:26:48.879775 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 360/706] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:49.003382 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] validate_networks() for [('923db031-4095-45ac-869f-da21aba3a797', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:26:49.064567 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-393bf160-4642-4869-96e0-477e579835d5 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:49.065933 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-393bf160-4642-4869-96e0-477e579835d5 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:49.074939 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-393bf160-4642-4869-96e0-477e579835d5 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:49.075554 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-393bf160-4642-4869-96e0-477e579835d5 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:49.076952 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-393bf160-4642-4869-96e0-477e579835d5 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:49.080751 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-393bf160-4642-4869-96e0-477e579835d5 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:49.092125 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-393bf160-4642-4869-96e0-477e579835d5 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:49.092951 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-393bf160-4642-4869-96e0-477e579835d5 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:49.410733 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-393bf160-4642-4869-96e0-477e579835d5 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:49.431614 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-393bf160-4642-4869-96e0-477e579835d5 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1266 microversion: 2.1 time: 0.373711 Aug 31 00:26:49.432930 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 361/707] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:49 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1266 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:49.442711 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:49.444195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:49.456854 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:49.458701 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:49.459710 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:49.461302 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:49.462129 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:49.462874 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:49.876937 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:49.891589 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:49.895158 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:49.897022 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-410e593f-ac72-43ba-89ec-54a7aa6b18b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.462048 Aug 31 00:26:49.908193 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 362/708] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:49 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:49.908193 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-df17bbcc-4458-4ed1-a4fb-901e981e184c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:49.908193 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-df17bbcc-4458-4ed1-a4fb-901e981e184c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:49.921510 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df17bbcc-4458-4ed1-a4fb-901e981e184c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:49.922433 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df17bbcc-4458-4ed1-a4fb-901e981e184c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:49.922883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df17bbcc-4458-4ed1-a4fb-901e981e184c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:49.923825 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df17bbcc-4458-4ed1-a4fb-901e981e184c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:49.924323 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df17bbcc-4458-4ed1-a4fb-901e981e184c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:49.924755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df17bbcc-4458-4ed1-a4fb-901e981e184c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:49.959459 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-df17bbcc-4458-4ed1-a4fb-901e981e184c tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/ips" status: 200 len: 146 microversion: 2.1 time: 0.059250 Aug 31 00:26:49.965693 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:26:49.967451 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:26:49.968177 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:26:49.968789 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:26:49.969240 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:26:49.971563 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 363/709] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 31 00:26:49 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/ips => generated 146 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:49.980488 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:49.987366 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:49.987932 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:49.988796 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:49.989861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:49.991363 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:50.022117 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:26:50.027368 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Getting quotas for user b3da9d7af0fd4c1d99973e6b277b16d2 and project dbe3f343119e4f10828c98ef17e8da5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:26:50.042248 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:26:50.044994 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:26:50.102700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d7ea5cbb-4989-4d3b-bc54-0870b6176bf7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.437494 Aug 31 00:26:50.105978 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 347/710] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:26:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:26:50.150651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-aba70019-c9d9-475e-a1ad-0069e4e62ee8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:50.153703 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-aba70019-c9d9-475e-a1ad-0069e4e62ee8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:50.320109 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-aba70019-c9d9-475e-a1ad-0069e4e62ee8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:50.329194 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-aba70019-c9d9-475e-a1ad-0069e4e62ee8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1240 microversion: 2.1 time: 0.215310 Aug 31 00:26:50.359932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 364/711] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:50 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1240 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:50.474507 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-163facae-98de-4b0d-9ecf-f1ca61b8a056 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:50.475558 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-163facae-98de-4b0d-9ecf-f1ca61b8a056 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:50.489999 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-163facae-98de-4b0d-9ecf-f1ca61b8a056 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:50.491393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-163facae-98de-4b0d-9ecf-f1ca61b8a056 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:50.492219 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-163facae-98de-4b0d-9ecf-f1ca61b8a056 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:50.494755 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-163facae-98de-4b0d-9ecf-f1ca61b8a056 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:50.495566 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-163facae-98de-4b0d-9ecf-f1ca61b8a056 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:50.496418 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-163facae-98de-4b0d-9ecf-f1ca61b8a056 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:50.812463 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-163facae-98de-4b0d-9ecf-f1ca61b8a056 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:50.822185 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-163facae-98de-4b0d-9ecf-f1ca61b8a056 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1266 microversion: 2.1 time: 0.358177 Aug 31 00:26:50.836903 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 348/712] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:50 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1266 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:50.931384 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:50.932724 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:50.947668 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:50.948593 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:50.949835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:50.951392 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:50.952284 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:50.953074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:51.270300 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:51.282418 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:51.284624 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:51.287454 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1ab307a6-488e-4b3e-abb4-7d9f6a885764 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.368323 Aug 31 00:26:51.288521 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 365/713] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:50 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:51.356499 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2a5f52f4-5181-43f8-9c3d-b5c7592e3f98 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:51.357363 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2a5f52f4-5181-43f8-9c3d-b5c7592e3f98 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:51.367155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a5f52f4-5181-43f8-9c3d-b5c7592e3f98 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:51.367987 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a5f52f4-5181-43f8-9c3d-b5c7592e3f98 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:51.368750 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a5f52f4-5181-43f8-9c3d-b5c7592e3f98 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:51.369963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a5f52f4-5181-43f8-9c3d-b5c7592e3f98 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:51.370742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a5f52f4-5181-43f8-9c3d-b5c7592e3f98 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:51.371750 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2a5f52f4-5181-43f8-9c3d-b5c7592e3f98 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:51.466800 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2a5f52f4-5181-43f8-9c3d-b5c7592e3f98 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:51.485733 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2a5f52f4-5181-43f8-9c3d-b5c7592e3f98 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1292 microversion: 2.1 time: 0.135059 Aug 31 00:26:51.486713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 349/714] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:51 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1292 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:51.590833 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e3ba1393-c786-4398-b507-d836461ba2d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3742d50c-a0ca-4543-8ecd-b8715fa968c6"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:51.597315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e3ba1393-c786-4398-b507-d836461ba2d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:51.608679 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3ba1393-c786-4398-b507-d836461ba2d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:51.609689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3ba1393-c786-4398-b507-d836461ba2d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:51.610219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3ba1393-c786-4398-b507-d836461ba2d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:51.611222 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3ba1393-c786-4398-b507-d836461ba2d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:51.611761 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3ba1393-c786-4398-b507-d836461ba2d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:51.612327 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3ba1393-c786-4398-b507-d836461ba2d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:51.770067 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:51.850025 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-de21dd5b-72f9-4848-a738-374728027ea0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:51.850800 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-de21dd5b-72f9-4848-a738-374728027ea0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:51.861508 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de21dd5b-72f9-4848-a738-374728027ea0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:51.862288 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de21dd5b-72f9-4848-a738-374728027ea0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:51.863074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de21dd5b-72f9-4848-a738-374728027ea0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:51.864395 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de21dd5b-72f9-4848-a738-374728027ea0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:51.866695 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de21dd5b-72f9-4848-a738-374728027ea0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:51.867760 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de21dd5b-72f9-4848-a738-374728027ea0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:52.212086 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e3ba1393-c786-4398-b507-d836461ba2d0 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "POST /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.628225 Aug 31 00:26:52.213319 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 366/715] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:26:51 2022] POST /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:52.344088 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:52.345981 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:52.359943 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:52.361571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:52.362636 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:52.364709 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:52.367183 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:52.369025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:52.380528 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:52.747070 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-de21dd5b-72f9-4848-a738-374728027ea0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:52.763630 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-de21dd5b-72f9-4848-a738-374728027ea0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1266 microversion: 2.1 time: 0.919714 Aug 31 00:26:52.764878 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 350/716] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:51 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1266 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:52.774029 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6d835155-396b-4cf1-8ead-2282dfb8c648 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:52.775716 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6d835155-396b-4cf1-8ead-2282dfb8c648 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:52.779662 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:52.795801 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:52.797436 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6d835155-396b-4cf1-8ead-2282dfb8c648 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:52.798434 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6d835155-396b-4cf1-8ead-2282dfb8c648 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:52.799353 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6d835155-396b-4cf1-8ead-2282dfb8c648 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:52.799731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:52.800922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6d835155-396b-4cf1-8ead-2282dfb8c648 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:52.801831 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6d835155-396b-4cf1-8ead-2282dfb8c648 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:52.802633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6d835155-396b-4cf1-8ead-2282dfb8c648 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:52.802831 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-51d61a29-26bd-4501-9d46-d02165b994c0 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.474299 Aug 31 00:26:52.803873 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 367/717] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:52 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:52.810978 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:52.996140 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6d835155-396b-4cf1-8ead-2282dfb8c648 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:53.018478 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6d835155-396b-4cf1-8ead-2282dfb8c648 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1298 microversion: 2.1 time: 0.250172 Aug 31 00:26:53.019907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 351/718] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:52 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1298 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:53.816400 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8214d554-e0a4-456c-a8df-c3d3db911bf8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:53.819293 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8214d554-e0a4-456c-a8df-c3d3db911bf8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:53.833178 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:53.836949 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:53.839822 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8214d554-e0a4-456c-a8df-c3d3db911bf8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:53.841152 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8214d554-e0a4-456c-a8df-c3d3db911bf8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:53.842925 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8214d554-e0a4-456c-a8df-c3d3db911bf8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:53.844311 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8214d554-e0a4-456c-a8df-c3d3db911bf8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:53.848124 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8214d554-e0a4-456c-a8df-c3d3db911bf8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:53.849625 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8214d554-e0a4-456c-a8df-c3d3db911bf8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:53.871610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:53.873473 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:53.874439 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:53.875822 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:53.876682 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:53.877752 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:54.388712 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8214d554-e0a4-456c-a8df-c3d3db911bf8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:54.399809 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8214d554-e0a4-456c-a8df-c3d3db911bf8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1266 microversion: 2.1 time: 0.599554 Aug 31 00:26:54.401053 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 368/719] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:53 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1266 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:54.407563 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ef40234c-5a7f-49a5-8e65-5754eb840db7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:54.408382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ef40234c-5a7f-49a5-8e65-5754eb840db7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:54.423666 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ef40234c-5a7f-49a5-8e65-5754eb840db7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:54.431416 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ef40234c-5a7f-49a5-8e65-5754eb840db7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:54.431416 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ef40234c-5a7f-49a5-8e65-5754eb840db7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:54.432007 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:54.432213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ef40234c-5a7f-49a5-8e65-5754eb840db7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:54.432213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ef40234c-5a7f-49a5-8e65-5754eb840db7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:54.432213 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ef40234c-5a7f-49a5-8e65-5754eb840db7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:54.442704 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:54.447218 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:54.450157 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-387d87c0-f79b-4b7b-b72f-2c63eae4f510 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.625451 Aug 31 00:26:54.452081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 352/720] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:53 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:54.762426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ef40234c-5a7f-49a5-8e65-5754eb840db7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:54.784498 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ef40234c-5a7f-49a5-8e65-5754eb840db7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1365 microversion: 2.1 time: 0.382043 Aug 31 00:26:54.785472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 369/721] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:54 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1365 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:55.226984 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-24494da0-b261-45b8-85fb-d9fb943c1b2c req-3f8efa02-b1ca-40f2-88e5-f40b5963edf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13034131-50e5-4af9-866a-d1886e4f1d1f", "tag": "3bf14da9-ff0f-4d44-b9b5-dc459021416b"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:55.248494 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-24494da0-b261-45b8-85fb-d9fb943c1b2c req-3f8efa02-b1ca-40f2-88e5-f40b5963edf2 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:55.249363 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-24494da0-b261-45b8-85fb-d9fb943c1b2c req-3f8efa02-b1ca-40f2-88e5-f40b5963edf2 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:55.250117 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-24494da0-b261-45b8-85fb-d9fb943c1b2c req-3f8efa02-b1ca-40f2-88e5-f40b5963edf2 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:55.273517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-24494da0-b261-45b8-85fb-d9fb943c1b2c req-3f8efa02-b1ca-40f2-88e5-f40b5963edf2 service nova] Creating event network-changed:3bf14da9-ff0f-4d44-b9b5-dc459021416b for instance 13034131-50e5-4af9-866a-d1886e4f1d1f on hv-cinder-85221 Aug 31 00:26:55.284494 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-24494da0-b261-45b8-85fb-d9fb943c1b2c req-3f8efa02-b1ca-40f2-88e5-f40b5963edf2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064374 Aug 31 00:26:55.285507 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 353/722] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:55.438910 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3b841cb6-46e3-4f47-9abc-50dcfc17b7bd tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:55.439676 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3b841cb6-46e3-4f47-9abc-50dcfc17b7bd tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:55.446286 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b841cb6-46e3-4f47-9abc-50dcfc17b7bd tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:55.446776 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b841cb6-46e3-4f47-9abc-50dcfc17b7bd tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:55.447219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b841cb6-46e3-4f47-9abc-50dcfc17b7bd tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:55.447949 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b841cb6-46e3-4f47-9abc-50dcfc17b7bd tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:55.448448 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b841cb6-46e3-4f47-9abc-50dcfc17b7bd tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:55.448898 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b841cb6-46e3-4f47-9abc-50dcfc17b7bd tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:55.489464 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:55.490774 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:55.500532 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:55.501223 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:55.501763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:55.502750 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:55.503414 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:55.504550 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:55.829634 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3b841cb6-46e3-4f47-9abc-50dcfc17b7bd tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:55.841043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:55.847405 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3b841cb6-46e3-4f47-9abc-50dcfc17b7bd tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1266 microversion: 2.1 time: 0.411186 Aug 31 00:26:55.851195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 370/723] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:55 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1266 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:55.860749 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ffc2f2e3-93bc-4f10-8f89-3aa0fe94ddee tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:55.862064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ffc2f2e3-93bc-4f10-8f89-3aa0fe94ddee tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:55.872241 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:55.874261 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffc2f2e3-93bc-4f10-8f89-3aa0fe94ddee tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:55.875263 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffc2f2e3-93bc-4f10-8f89-3aa0fe94ddee tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:55.876183 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:55.876798 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffc2f2e3-93bc-4f10-8f89-3aa0fe94ddee tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:55.878196 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffc2f2e3-93bc-4f10-8f89-3aa0fe94ddee tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:55.878615 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-24b3f245-45ca-4dff-a73e-170ff4e25162 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.399073 Aug 31 00:26:55.879077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffc2f2e3-93bc-4f10-8f89-3aa0fe94ddee tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:55.879705 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ffc2f2e3-93bc-4f10-8f89-3aa0fe94ddee tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:55.881085 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 354/724] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:55 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:56.273427 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ffc2f2e3-93bc-4f10-8f89-3aa0fe94ddee tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:56.282691 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ffc2f2e3-93bc-4f10-8f89-3aa0fe94ddee tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1365 microversion: 2.1 time: 0.432357 Aug 31 00:26:56.283617 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 371/725] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:55 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1365 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:56.889344 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ac220b2d-de2a-422e-9593-50145c78b0cc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:56.891431 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ac220b2d-de2a-422e-9593-50145c78b0cc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:56.902624 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac220b2d-de2a-422e-9593-50145c78b0cc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:56.903494 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac220b2d-de2a-422e-9593-50145c78b0cc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:56.904872 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac220b2d-de2a-422e-9593-50145c78b0cc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:56.906428 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac220b2d-de2a-422e-9593-50145c78b0cc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:56.907518 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac220b2d-de2a-422e-9593-50145c78b0cc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:56.908146 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:56.908846 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ac220b2d-de2a-422e-9593-50145c78b0cc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:56.909994 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:56.928852 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:56.930054 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:56.931012 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:56.934034 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:56.936852 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:56.938112 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:57.350286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ac220b2d-de2a-422e-9593-50145c78b0cc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:57.365478 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:57.382727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:57.385787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:57.386242 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ac220b2d-de2a-422e-9593-50145c78b0cc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1266 microversion: 2.1 time: 0.503419 Aug 31 00:26:57.387810 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 355/726] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:56 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1266 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:57.389719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e6d23cd1-7cee-4c82-a252-9e97547e30c8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.487485 Aug 31 00:26:57.391055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 372/727] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:56 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:57.399021 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7324c5ab-2271-4a25-b762-872430ece380 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:57.401742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7324c5ab-2271-4a25-b762-872430ece380 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:57.411873 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7324c5ab-2271-4a25-b762-872430ece380 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:57.412615 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7324c5ab-2271-4a25-b762-872430ece380 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:57.413153 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7324c5ab-2271-4a25-b762-872430ece380 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:57.414058 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7324c5ab-2271-4a25-b762-872430ece380 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:57.414619 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7324c5ab-2271-4a25-b762-872430ece380 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:57.415285 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7324c5ab-2271-4a25-b762-872430ece380 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:57.645814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7324c5ab-2271-4a25-b762-872430ece380 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:57.668046 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7324c5ab-2271-4a25-b762-872430ece380 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1365 microversion: 2.1 time: 0.277671 Aug 31 00:26:57.670561 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 356/728] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:57 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:58.194912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8c99943e-9f58-4ba5-895b-beb3d7f22022 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:58.195571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8c99943e-9f58-4ba5-895b-beb3d7f22022 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:58.202548 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c99943e-9f58-4ba5-895b-beb3d7f22022 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:58.203041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c99943e-9f58-4ba5-895b-beb3d7f22022 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:58.203483 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c99943e-9f58-4ba5-895b-beb3d7f22022 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:58.204235 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c99943e-9f58-4ba5-895b-beb3d7f22022 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:58.204726 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c99943e-9f58-4ba5-895b-beb3d7f22022 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:58.205156 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8c99943e-9f58-4ba5-895b-beb3d7f22022 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:58.231694 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-8c99943e-9f58-4ba5-895b-beb3d7f22022 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lazy-loading 'flavor' on Instance uuid c95e1f70-6a63-40b2-a053-4b043f6b1ffa {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:58.332892 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8c99943e-9f58-4ba5-895b-beb3d7f22022 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "POST /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.141938 Aug 31 00:26:58.334160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 373/729] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:26:58 2022] POST /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:26:58.343395 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e7c83254-0e6b-4141-a77c-ef06ac21a45a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:58.344045 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e7c83254-0e6b-4141-a77c-ef06ac21a45a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:58.359131 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7c83254-0e6b-4141-a77c-ef06ac21a45a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:58.359755 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7c83254-0e6b-4141-a77c-ef06ac21a45a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:58.360353 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7c83254-0e6b-4141-a77c-ef06ac21a45a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:58.361215 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7c83254-0e6b-4141-a77c-ef06ac21a45a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:58.361783 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7c83254-0e6b-4141-a77c-ef06ac21a45a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:58.362338 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e7c83254-0e6b-4141-a77c-ef06ac21a45a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:58.414921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b233fb40-f6f3-459e-82c4-001bc6a53b79 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:58.416188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b233fb40-f6f3-459e-82c4-001bc6a53b79 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:58.439047 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b233fb40-f6f3-459e-82c4-001bc6a53b79 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:58.440103 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b233fb40-f6f3-459e-82c4-001bc6a53b79 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:58.441145 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b233fb40-f6f3-459e-82c4-001bc6a53b79 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:58.445147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b233fb40-f6f3-459e-82c4-001bc6a53b79 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:58.446090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b233fb40-f6f3-459e-82c4-001bc6a53b79 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:58.446973 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b233fb40-f6f3-459e-82c4-001bc6a53b79 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:58.636735 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e7c83254-0e6b-4141-a77c-ef06ac21a45a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:58.653364 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e7c83254-0e6b-4141-a77c-ef06ac21a45a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.313953 Aug 31 00:26:58.655485 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 357/730] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:58 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:58.664799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:58.666487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:58.679487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:58.680825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:58.682138 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:58.683355 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:58.684111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:58.684926 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:58.726614 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b233fb40-f6f3-459e-82c4-001bc6a53b79 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:58.748567 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b233fb40-f6f3-459e-82c4-001bc6a53b79 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1266 microversion: 2.1 time: 0.338437 Aug 31 00:26:58.751356 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 374/731] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:58 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:58.761804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-642f4221-4a43-40dc-9f71-16f15876f366 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:58.764005 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-642f4221-4a43-40dc-9f71-16f15876f366 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:58.776642 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f4221-4a43-40dc-9f71-16f15876f366 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:58.777695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f4221-4a43-40dc-9f71-16f15876f366 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:58.778747 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f4221-4a43-40dc-9f71-16f15876f366 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:58.779880 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f4221-4a43-40dc-9f71-16f15876f366 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:58.781671 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f4221-4a43-40dc-9f71-16f15876f366 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:58.782452 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f4221-4a43-40dc-9f71-16f15876f366 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:59.070885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-642f4221-4a43-40dc-9f71-16f15876f366 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:59.084782 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-642f4221-4a43-40dc-9f71-16f15876f366 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1365 microversion: 2.1 time: 0.330225 Aug 31 00:26:59.085087 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:59.085377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 375/732] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:58 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:59.110807 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:59.113807 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:59.116405 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f0fe1113-8b1d-4bc1-8a14-3ca2f440b9c1 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.458770 Aug 31 00:26:59.117633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 358/733] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:58 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:59.678006 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4d98679a-d6eb-45b1-a0c0-b9a43ca5a7d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:59.678672 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4d98679a-d6eb-45b1-a0c0-b9a43ca5a7d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:59.687034 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d98679a-d6eb-45b1-a0c0-b9a43ca5a7d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:59.687930 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d98679a-d6eb-45b1-a0c0-b9a43ca5a7d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:59.688755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d98679a-d6eb-45b1-a0c0-b9a43ca5a7d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:59.690141 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d98679a-d6eb-45b1-a0c0-b9a43ca5a7d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:59.690746 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d98679a-d6eb-45b1-a0c0-b9a43ca5a7d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:59.691185 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4d98679a-d6eb-45b1-a0c0-b9a43ca5a7d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:59.777361 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-27702c16-c5e5-472e-a589-551423bf5977 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:59.778159 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-27702c16-c5e5-472e-a589-551423bf5977 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:59.789860 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27702c16-c5e5-472e-a589-551423bf5977 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:59.790745 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27702c16-c5e5-472e-a589-551423bf5977 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:59.791553 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27702c16-c5e5-472e-a589-551423bf5977 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:59.792832 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27702c16-c5e5-472e-a589-551423bf5977 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:59.793668 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27702c16-c5e5-472e-a589-551423bf5977 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:59.794589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27702c16-c5e5-472e-a589-551423bf5977 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:59.926788 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4d98679a-d6eb-45b1-a0c0-b9a43ca5a7d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:59.937592 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4d98679a-d6eb-45b1-a0c0-b9a43ca5a7d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.263478 Aug 31 00:26:59.938257 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 376/734] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:59 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:00.004181 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-27702c16-c5e5-472e-a589-551423bf5977 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:00.010186 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:00.018578 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-27702c16-c5e5-472e-a589-551423bf5977 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1266 microversion: 2.1 time: 0.249646 Aug 31 00:27:00.019277 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 359/735] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:59 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:00.131515 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-66e2e431-01fd-49ba-81e4-6151c4aba707 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:00.132681 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-66e2e431-01fd-49ba-81e4-6151c4aba707 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:00.147096 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66e2e431-01fd-49ba-81e4-6151c4aba707 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:00.148288 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66e2e431-01fd-49ba-81e4-6151c4aba707 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:00.149055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66e2e431-01fd-49ba-81e4-6151c4aba707 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:00.150545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66e2e431-01fd-49ba-81e4-6151c4aba707 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:00.151304 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66e2e431-01fd-49ba-81e4-6151c4aba707 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:00.152045 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66e2e431-01fd-49ba-81e4-6151c4aba707 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:00.155593 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:00.156764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:00.160012 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=8 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:00.168451 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:00.170081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:00.170525 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:00.171699 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:00.172534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:00.173262 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:00.326338 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=12 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:00.443729 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-66e2e431-01fd-49ba-81e4-6151c4aba707 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:00.448676 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:00.459466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:00.461035 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:00.462417 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8961fd58-fe1f-47c6-8242-155d755d0370 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1745 microversion: 2.20 time: 0.318456 Aug 31 00:27:00.463000 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 360/736] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:00 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1745 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:27:00.463731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-66e2e431-01fd-49ba-81e4-6151c4aba707 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1365 microversion: 2.1 time: 0.338310 Aug 31 00:27:00.465493 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 377/737] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:00 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:00.468878 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cfc4c560-4dbf-40ad-a2d6-4bfd39315cb7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:00.471460 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-cfc4c560-4dbf-40ad-a2d6-4bfd39315cb7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:00.478197 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfc4c560-4dbf-40ad-a2d6-4bfd39315cb7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:00.479057 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfc4c560-4dbf-40ad-a2d6-4bfd39315cb7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:00.479717 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfc4c560-4dbf-40ad-a2d6-4bfd39315cb7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:00.480703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfc4c560-4dbf-40ad-a2d6-4bfd39315cb7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:00.481397 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfc4c560-4dbf-40ad-a2d6-4bfd39315cb7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:00.482236 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfc4c560-4dbf-40ad-a2d6-4bfd39315cb7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:00.526594 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cfc4c560-4dbf-40ad-a2d6-4bfd39315cb7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061550 Aug 31 00:27:00.528265 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 361/738] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:27:00 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:00.554783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d16a7f70-058b-4c61-b7c0-d1359b6818ff tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:00.556325 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d16a7f70-058b-4c61-b7c0-d1359b6818ff tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:00.568941 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d16a7f70-058b-4c61-b7c0-d1359b6818ff tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:00.570221 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d16a7f70-058b-4c61-b7c0-d1359b6818ff tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:00.571235 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d16a7f70-058b-4c61-b7c0-d1359b6818ff tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:00.573041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d16a7f70-058b-4c61-b7c0-d1359b6818ff tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:00.574087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d16a7f70-058b-4c61-b7c0-d1359b6818ff tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:00.575536 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d16a7f70-058b-4c61-b7c0-d1359b6818ff tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:00.633463 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d16a7f70-058b-4c61-b7c0-d1359b6818ff tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments/3742d50c-a0ca-4543-8ecd-b8715fa968c6" status: 200 len: 194 microversion: 2.1 time: 0.091798 Aug 31 00:27:00.634515 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 378/739] 10.222.0.47 () {58 vars in 1413 bytes} [Wed Aug 31 00:27:00 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments/3742d50c-a0ca-4543-8ecd-b8715fa968c6 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:00.982547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8773b79d-c094-461f-9b56-0f9fd3ea18e7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:00.985795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8773b79d-c094-461f-9b56-0f9fd3ea18e7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:01.019314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8773b79d-c094-461f-9b56-0f9fd3ea18e7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:01.022001 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8773b79d-c094-461f-9b56-0f9fd3ea18e7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:01.028170 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8773b79d-c094-461f-9b56-0f9fd3ea18e7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:01.030744 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8773b79d-c094-461f-9b56-0f9fd3ea18e7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:01.032530 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8773b79d-c094-461f-9b56-0f9fd3ea18e7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:01.038652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8773b79d-c094-461f-9b56-0f9fd3ea18e7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:01.225971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-f4ecbc41-6aec-45c3-a50d-a273abf1a71f req-229c7d4b-81ee-4468-939e-e48f418566e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f5b45e-d0c7-461b-addb-c046c9cce995", "name": "network-vif-plugged", "status": "completed", "tag": "7ee0bda6-a8f6-49b1-b97f-b289c4493bf3"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:01.255971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f4ecbc41-6aec-45c3-a50d-a273abf1a71f req-229c7d4b-81ee-4468-939e-e48f418566e2 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:01.256891 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f4ecbc41-6aec-45c3-a50d-a273abf1a71f req-229c7d4b-81ee-4468-939e-e48f418566e2 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:01.257862 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f4ecbc41-6aec-45c3-a50d-a273abf1a71f req-229c7d4b-81ee-4468-939e-e48f418566e2 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:01.303788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-f4ecbc41-6aec-45c3-a50d-a273abf1a71f req-229c7d4b-81ee-4468-939e-e48f418566e2 service nova] Creating event network-vif-plugged:7ee0bda6-a8f6-49b1-b97f-b289c4493bf3 for instance b3f5b45e-d0c7-461b-addb-c046c9cce995 on hv-cinder-85221 Aug 31 00:27:01.334255 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-f4ecbc41-6aec-45c3-a50d-a273abf1a71f req-229c7d4b-81ee-4468-939e-e48f418566e2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.477647 Aug 31 00:27:01.335438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 362/740] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:27:01.352500 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7fdcf040-8fba-45d5-b6ab-bb0126d0eef7 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:01.353238 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7fdcf040-8fba-45d5-b6ab-bb0126d0eef7 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:01.374027 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8773b79d-c094-461f-9b56-0f9fd3ea18e7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:01.375832 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fdcf040-8fba-45d5-b6ab-bb0126d0eef7 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:01.377127 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fdcf040-8fba-45d5-b6ab-bb0126d0eef7 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:01.378172 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fdcf040-8fba-45d5-b6ab-bb0126d0eef7 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:01.380051 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fdcf040-8fba-45d5-b6ab-bb0126d0eef7 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:01.381517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fdcf040-8fba-45d5-b6ab-bb0126d0eef7 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:01.383405 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7fdcf040-8fba-45d5-b6ab-bb0126d0eef7 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:01.400375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8773b79d-c094-461f-9b56-0f9fd3ea18e7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.428046 Aug 31 00:27:01.402790 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 379/741] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:00 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:01.503095 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:01.504134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:01.517445 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:01.518514 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:01.519307 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:01.520673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:01.521515 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:01.522293 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:01.768492 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7fdcf040-8fba-45d5-b6ab-bb0126d0eef7 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:01.783084 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7fdcf040-8fba-45d5-b6ab-bb0126d0eef7 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1266 microversion: 2.1 time: 0.445812 Aug 31 00:27:01.799077 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 363/742] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:01 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1266 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:01.806978 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-09f55095-c854-4ce5-9004-3759aeb524cc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:01.808244 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-09f55095-c854-4ce5-9004-3759aeb524cc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:01.817570 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-09f55095-c854-4ce5-9004-3759aeb524cc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:01.818174 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-09f55095-c854-4ce5-9004-3759aeb524cc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:01.818746 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-09f55095-c854-4ce5-9004-3759aeb524cc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:01.820217 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-09f55095-c854-4ce5-9004-3759aeb524cc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:01.820895 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-09f55095-c854-4ce5-9004-3759aeb524cc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:01.821455 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-09f55095-c854-4ce5-9004-3759aeb524cc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:01.846557 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:01.875909 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:01.877900 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:01.879883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-92d6d63a-cdbb-4ac2-bbb5-0985f097c94b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1745 microversion: 2.20 time: 0.381442 Aug 31 00:27:01.880916 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 380/743] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:01 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1745 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:27:02.043474 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-09f55095-c854-4ce5-9004-3759aeb524cc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:02.053662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-09f55095-c854-4ce5-9004-3759aeb524cc tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1365 microversion: 2.1 time: 0.267390 Aug 31 00:27:02.054265 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 364/744] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:01 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:02.434677 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c9ef3dcb-4c48-4bc2-811f-a5b78ed49449 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d76874bf-bce5-44cb-bff1-224953b8e980"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:02.438014 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c9ef3dcb-4c48-4bc2-811f-a5b78ed49449 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:02.446024 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9ef3dcb-4c48-4bc2-811f-a5b78ed49449 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:02.446531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9ef3dcb-4c48-4bc2-811f-a5b78ed49449 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:02.446969 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9ef3dcb-4c48-4bc2-811f-a5b78ed49449 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:02.447721 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9ef3dcb-4c48-4bc2-811f-a5b78ed49449 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:02.448205 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9ef3dcb-4c48-4bc2-811f-a5b78ed49449 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:02.448647 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9ef3dcb-4c48-4bc2-811f-a5b78ed49449 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:02.450181 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f0799847-7e36-4f4d-9e5e-9dcb48a092f2 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:02.451864 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f0799847-7e36-4f4d-9e5e-9dcb48a092f2 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:02.468137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0799847-7e36-4f4d-9e5e-9dcb48a092f2 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:02.469139 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0799847-7e36-4f4d-9e5e-9dcb48a092f2 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:02.470147 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0799847-7e36-4f4d-9e5e-9dcb48a092f2 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:02.471588 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0799847-7e36-4f4d-9e5e-9dcb48a092f2 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:02.472481 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0799847-7e36-4f4d-9e5e-9dcb48a092f2 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:02.473313 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f0799847-7e36-4f4d-9e5e-9dcb48a092f2 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:02.546518 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:02.707813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f0799847-7e36-4f4d-9e5e-9dcb48a092f2 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:02.726840 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f0799847-7e36-4f4d-9e5e-9dcb48a092f2 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.282341 Aug 31 00:27:02.743453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 365/745] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:02 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:02.821394 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c13d57d2-8a4a-4178-baa9-217d24a592bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:02.822526 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c13d57d2-8a4a-4178-baa9-217d24a592bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:02.836181 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c13d57d2-8a4a-4178-baa9-217d24a592bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:02.837065 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c13d57d2-8a4a-4178-baa9-217d24a592bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:02.837841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c13d57d2-8a4a-4178-baa9-217d24a592bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:02.838743 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c13d57d2-8a4a-4178-baa9-217d24a592bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:02.843967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c13d57d2-8a4a-4178-baa9-217d24a592bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:02.844612 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c13d57d2-8a4a-4178-baa9-217d24a592bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:03.241844 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c9ef3dcb-4c48-4bc2-811f-a5b78ed49449 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "POST /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.809118 Aug 31 00:27:03.249887 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 381/746] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:27:02 2022] POST /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:03.276747 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:03.279144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:03.307276 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:03.314036 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:03.320544 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:03.320544 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:03.333830 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c13d57d2-8a4a-4178-baa9-217d24a592bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:03.334855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:03.342722 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:03.344375 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c13d57d2-8a4a-4178-baa9-217d24a592bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1266 microversion: 2.1 time: 0.526793 Aug 31 00:27:03.344979 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 366/747] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:02 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1266 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:03.350221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d80bc1f2-9f05-4a17-9797-e93cbded11b4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:03.351115 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d80bc1f2-9f05-4a17-9797-e93cbded11b4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:03.359377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d80bc1f2-9f05-4a17-9797-e93cbded11b4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:03.360301 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d80bc1f2-9f05-4a17-9797-e93cbded11b4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:03.360991 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d80bc1f2-9f05-4a17-9797-e93cbded11b4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:03.362509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d80bc1f2-9f05-4a17-9797-e93cbded11b4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:03.363348 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d80bc1f2-9f05-4a17-9797-e93cbded11b4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:03.364093 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d80bc1f2-9f05-4a17-9797-e93cbded11b4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:03.781931 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d80bc1f2-9f05-4a17-9797-e93cbded11b4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:03.841185 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:03.852927 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d80bc1f2-9f05-4a17-9797-e93cbded11b4 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1365 microversion: 2.1 time: 0.504941 Aug 31 00:27:03.855882 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 367/748] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:03 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1365 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:03.869918 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-a612dfea-4b0e-49ec-a4d6-372f5b55519c req-820c1769-cdc6-49af-be2f-8ae36842b187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13034131-50e5-4af9-866a-d1886e4f1d1f", "name": "network-vif-plugged", "status": "completed", "tag": "3bf14da9-ff0f-4d44-b9b5-dc459021416b"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:03.876358 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:03.882589 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:03.886829 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-531344c4-6c0a-4320-9a58-4ed9488b8b6a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 0.636986 Aug 31 00:27:03.891474 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 382/749] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:03 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:03.903445 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a612dfea-4b0e-49ec-a4d6-372f5b55519c req-820c1769-cdc6-49af-be2f-8ae36842b187 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:03.905795 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a612dfea-4b0e-49ec-a4d6-372f5b55519c req-820c1769-cdc6-49af-be2f-8ae36842b187 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:03.907054 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a612dfea-4b0e-49ec-a4d6-372f5b55519c req-820c1769-cdc6-49af-be2f-8ae36842b187 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:03.920202 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9deda780-ed00-4edf-b303-5da1c63e1eeb tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:03.922481 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9deda780-ed00-4edf-b303-5da1c63e1eeb tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:03.954222 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9deda780-ed00-4edf-b303-5da1c63e1eeb tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:03.954517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-a612dfea-4b0e-49ec-a4d6-372f5b55519c req-820c1769-cdc6-49af-be2f-8ae36842b187 service nova] Creating event network-vif-plugged:3bf14da9-ff0f-4d44-b9b5-dc459021416b for instance 13034131-50e5-4af9-866a-d1886e4f1d1f on hv-cinder-85221 Aug 31 00:27:03.961003 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9deda780-ed00-4edf-b303-5da1c63e1eeb tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:03.961718 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9deda780-ed00-4edf-b303-5da1c63e1eeb tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:03.967962 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9deda780-ed00-4edf-b303-5da1c63e1eeb tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:03.969985 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9deda780-ed00-4edf-b303-5da1c63e1eeb tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:03.978629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9deda780-ed00-4edf-b303-5da1c63e1eeb tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:03.995605 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-a612dfea-4b0e-49ec-a4d6-372f5b55519c req-820c1769-cdc6-49af-be2f-8ae36842b187 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131260 Aug 31 00:27:04.009263 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 368/750] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:04.391935 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ab37b56c-646b-4661-959a-291ec9b54006 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:04.395455 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ab37b56c-646b-4661-959a-291ec9b54006 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:04.445350 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab37b56c-646b-4661-959a-291ec9b54006 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:04.446239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab37b56c-646b-4661-959a-291ec9b54006 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:04.447376 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab37b56c-646b-4661-959a-291ec9b54006 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:04.449166 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab37b56c-646b-4661-959a-291ec9b54006 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:04.450426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9deda780-ed00-4edf-b303-5da1c63e1eeb tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:04.450987 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab37b56c-646b-4661-959a-291ec9b54006 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:04.451791 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ab37b56c-646b-4661-959a-291ec9b54006 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:04.495063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9deda780-ed00-4edf-b303-5da1c63e1eeb tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.601483 Aug 31 00:27:04.496419 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 383/751] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:03 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:04.877091 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c9aa61cb-1886-4a6a-8282-5058c1e2ed78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:04.878197 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c9aa61cb-1886-4a6a-8282-5058c1e2ed78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:04.889014 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9aa61cb-1886-4a6a-8282-5058c1e2ed78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:04.891906 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9aa61cb-1886-4a6a-8282-5058c1e2ed78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:04.892795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9aa61cb-1886-4a6a-8282-5058c1e2ed78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:04.893792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9aa61cb-1886-4a6a-8282-5058c1e2ed78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:04.894353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9aa61cb-1886-4a6a-8282-5058c1e2ed78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:04.894866 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c9aa61cb-1886-4a6a-8282-5058c1e2ed78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:05.141937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ab37b56c-646b-4661-959a-291ec9b54006 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:05.153994 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=100 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:05.176188 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ab37b56c-646b-4661-959a-291ec9b54006 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1453 microversion: 2.1 time: 0.793473 Aug 31 00:27:05.177702 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 369/752] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:04 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1453 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:05.207487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:05.209750 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:05.210845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c9aa61cb-1886-4a6a-8282-5058c1e2ed78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:05.224486 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:05.225838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:05.226601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c9aa61cb-1886-4a6a-8282-5058c1e2ed78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1365 microversion: 2.1 time: 0.353686 Aug 31 00:27:05.227095 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:05.228672 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:05.230076 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:05.231106 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:05.237276 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 384/753] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:04 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1365 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:05.251408 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-cab493f4-ea14-40d5-8936-755dd5b1471b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:05.254232 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-cab493f4-ea14-40d5-8936-755dd5b1471b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:05.270269 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab493f4-ea14-40d5-8936-755dd5b1471b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:05.273301 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab493f4-ea14-40d5-8936-755dd5b1471b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:05.275063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab493f4-ea14-40d5-8936-755dd5b1471b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:05.276032 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab493f4-ea14-40d5-8936-755dd5b1471b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:05.278006 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab493f4-ea14-40d5-8936-755dd5b1471b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:05.283136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cab493f4-ea14-40d5-8936-755dd5b1471b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:05.588967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:05.600244 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:05.602453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:05.604507 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7924899f-d261-4f5e-8f96-bed6cbe3aad7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 0.423847 Aug 31 00:27:05.605949 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 370/754] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:05 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:05.620091 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f96e93c9-526b-4901-8ca5-c4e93e282a70 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:05.621731 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f96e93c9-526b-4901-8ca5-c4e93e282a70 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:05.643412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f96e93c9-526b-4901-8ca5-c4e93e282a70 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:05.643919 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f96e93c9-526b-4901-8ca5-c4e93e282a70 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:05.644413 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f96e93c9-526b-4901-8ca5-c4e93e282a70 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:05.645135 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f96e93c9-526b-4901-8ca5-c4e93e282a70 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:05.645780 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f96e93c9-526b-4901-8ca5-c4e93e282a70 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:05.646210 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f96e93c9-526b-4901-8ca5-c4e93e282a70 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:05.661450 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-cab493f4-ea14-40d5-8936-755dd5b1471b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:05.692693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-cab493f4-ea14-40d5-8936-755dd5b1471b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1453 microversion: 2.1 time: 0.449829 Aug 31 00:27:05.697676 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 385/755] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:05 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1453 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:05.889423 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f96e93c9-526b-4901-8ca5-c4e93e282a70 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:05.906557 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f96e93c9-526b-4901-8ca5-c4e93e282a70 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.298795 Aug 31 00:27:05.907726 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 371/756] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:05 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:06.040651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-ac83c420-a86f-4c32-8022-0f18b580754a req-8a02973a-46e8-4c05-944a-b38cbbd98662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698d47ed-0a7a-4601-87a9-beb0597d3045", "name": "network-vif-plugged", "status": "completed", "tag": "9e1236d0-86cd-45da-a9dc-878f6a1707a4"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:06.081814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-ac83c420-a86f-4c32-8022-0f18b580754a req-8a02973a-46e8-4c05-944a-b38cbbd98662 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:06.083376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-ac83c420-a86f-4c32-8022-0f18b580754a req-8a02973a-46e8-4c05-944a-b38cbbd98662 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:06.085163 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-ac83c420-a86f-4c32-8022-0f18b580754a req-8a02973a-46e8-4c05-944a-b38cbbd98662 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:06.126795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-ac83c420-a86f-4c32-8022-0f18b580754a req-8a02973a-46e8-4c05-944a-b38cbbd98662 service nova] Creating event network-vif-plugged:9e1236d0-86cd-45da-a9dc-878f6a1707a4 for instance 698d47ed-0a7a-4601-87a9-beb0597d3045 on hv-cinder-85221 Aug 31 00:27:06.144760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-ac83c420-a86f-4c32-8022-0f18b580754a req-8a02973a-46e8-4c05-944a-b38cbbd98662 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112576 Aug 31 00:27:06.146962 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 386/757] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 31 00:27:06.255212 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-69a1d409-b9e0-498c-9d2c-c9b4b9fbdbbd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:06.257302 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-69a1d409-b9e0-498c-9d2c-c9b4b9fbdbbd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:06.260891 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:06.271836 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-69a1d409-b9e0-498c-9d2c-c9b4b9fbdbbd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:06.273359 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-69a1d409-b9e0-498c-9d2c-c9b4b9fbdbbd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:06.274319 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-69a1d409-b9e0-498c-9d2c-c9b4b9fbdbbd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:06.275839 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-69a1d409-b9e0-498c-9d2c-c9b4b9fbdbbd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:06.277763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-69a1d409-b9e0-498c-9d2c-c9b4b9fbdbbd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:06.279486 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-69a1d409-b9e0-498c-9d2c-c9b4b9fbdbbd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:06.592816 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-69a1d409-b9e0-498c-9d2c-c9b4b9fbdbbd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:06.627629 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-69a1d409-b9e0-498c-9d2c-c9b4b9fbdbbd tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1365 microversion: 2.1 time: 0.376197 Aug 31 00:27:06.632338 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:06.633330 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:06.634779 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 372/758] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:06 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1365 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:06.659216 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:06.660265 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:06.661050 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:06.661972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:06.662594 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:06.664479 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:06.940169 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-97e0ccd5-d541-441d-a352-66d55d585c90 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:06.948382 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-97e0ccd5-d541-441d-a352-66d55d585c90 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:06.973110 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-97e0ccd5-d541-441d-a352-66d55d585c90 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:06.974021 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-97e0ccd5-d541-441d-a352-66d55d585c90 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:06.974630 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-97e0ccd5-d541-441d-a352-66d55d585c90 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:06.976715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-97e0ccd5-d541-441d-a352-66d55d585c90 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:06.978239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-97e0ccd5-d541-441d-a352-66d55d585c90 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:06.978941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-97e0ccd5-d541-441d-a352-66d55d585c90 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:07.111144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:07.131903 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:07.135098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:07.152736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5b8a35ab-1b79-4adc-a629-11bf30a695a6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 0.520330 Aug 31 00:27:07.154310 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 387/759] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:06 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:07.503815 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-97e0ccd5-d541-441d-a352-66d55d585c90 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:07.520924 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-97e0ccd5-d541-441d-a352-66d55d585c90 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.593204 Aug 31 00:27:07.538163 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 373/760] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:06 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:07.697659 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-30d45287-e656-4dce-b50a-9bda162b1337 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:07.699849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-30d45287-e656-4dce-b50a-9bda162b1337 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:07.708553 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:07.734692 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-30d45287-e656-4dce-b50a-9bda162b1337 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:07.736595 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-30d45287-e656-4dce-b50a-9bda162b1337 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:07.739140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-30d45287-e656-4dce-b50a-9bda162b1337 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:07.746400 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-30d45287-e656-4dce-b50a-9bda162b1337 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:07.752742 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-30d45287-e656-4dce-b50a-9bda162b1337 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:07.754780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-30d45287-e656-4dce-b50a-9bda162b1337 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:07.997867 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-30d45287-e656-4dce-b50a-9bda162b1337 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:08.021454 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-30d45287-e656-4dce-b50a-9bda162b1337 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1555 microversion: 2.1 time: 0.350755 Aug 31 00:27:08.022314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 388/761] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:07 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1555 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:08.050676 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-12d2bcbb-6c4d-48d3-a2bf-3e986bebce83 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:08.051527 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-12d2bcbb-6c4d-48d3-a2bf-3e986bebce83 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:08.059575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-12d2bcbb-6c4d-48d3-a2bf-3e986bebce83 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:08.061243 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-12d2bcbb-6c4d-48d3-a2bf-3e986bebce83 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:08.061740 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-12d2bcbb-6c4d-48d3-a2bf-3e986bebce83 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:08.062507 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-12d2bcbb-6c4d-48d3-a2bf-3e986bebce83 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:08.062975 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-12d2bcbb-6c4d-48d3-a2bf-3e986bebce83 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:08.063430 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-12d2bcbb-6c4d-48d3-a2bf-3e986bebce83 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:08.216847 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:08.221153 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:08.221857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-12d2bcbb-6c4d-48d3-a2bf-3e986bebce83 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169699 Aug 31 00:27:08.223286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 374/762] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 31 00:27:08 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:08.273491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:08.289340 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:08.296567 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:08.308482 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:08.309152 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:08.309764 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:08.568460 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1d8d87aa-f715-4c7f-a8f4-3a35e1518616 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:08.572171 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1d8d87aa-f715-4c7f-a8f4-3a35e1518616 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:08.595352 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d8d87aa-f715-4c7f-a8f4-3a35e1518616 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:08.596050 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d8d87aa-f715-4c7f-a8f4-3a35e1518616 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:08.596657 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d8d87aa-f715-4c7f-a8f4-3a35e1518616 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:08.613586 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d8d87aa-f715-4c7f-a8f4-3a35e1518616 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:08.614464 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d8d87aa-f715-4c7f-a8f4-3a35e1518616 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:08.615234 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d8d87aa-f715-4c7f-a8f4-3a35e1518616 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:08.829305 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:08.847948 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:08.849824 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:08.856641 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0c41074c-6365-448b-ae78-c43409ee8c74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 0.662633 Aug 31 00:27:08.857265 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 389/763] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:08 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:27:09.121283 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1d8d87aa-f715-4c7f-a8f4-3a35e1518616 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:09.133743 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1d8d87aa-f715-4c7f-a8f4-3a35e1518616 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.577318 Aug 31 00:27:09.153903 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 375/764] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:08 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:09.880787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:09.881524 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:09.892713 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:09.895600 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:09.911072 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:09.913715 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:09.921451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:09.922244 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:10.171839 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5d4ba769-99c5-4db4-ad7a-9499f3ff3e55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:10.173038 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5d4ba769-99c5-4db4-ad7a-9499f3ff3e55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:10.210493 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d4ba769-99c5-4db4-ad7a-9499f3ff3e55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:10.211344 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d4ba769-99c5-4db4-ad7a-9499f3ff3e55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:10.220850 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d4ba769-99c5-4db4-ad7a-9499f3ff3e55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:10.223418 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d4ba769-99c5-4db4-ad7a-9499f3ff3e55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:10.224801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d4ba769-99c5-4db4-ad7a-9499f3ff3e55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:10.225992 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5d4ba769-99c5-4db4-ad7a-9499f3ff3e55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:10.546860 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:10.572959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:10.578482 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:10.581129 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a459a7d3-823f-4604-bd06-d4a85810e002 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 0.704918 Aug 31 00:27:10.603355 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 390/765] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:09 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:27:10.904060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5d4ba769-99c5-4db4-ad7a-9499f3ff3e55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:10.939964 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5d4ba769-99c5-4db4-ad7a-9499f3ff3e55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.777548 Aug 31 00:27:10.941008 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 376/766] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:10 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:10.953369 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-2f2be1e4-834d-468f-a363-5ba7ccbfe1af req-a0e75c1a-fd2b-40e6-8f41-2ca93e434c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13034131-50e5-4af9-866a-d1886e4f1d1f", "tag": "3bf14da9-ff0f-4d44-b9b5-dc459021416b"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:10.982446 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-2f2be1e4-834d-468f-a363-5ba7ccbfe1af req-a0e75c1a-fd2b-40e6-8f41-2ca93e434c06 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:10.983359 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-2f2be1e4-834d-468f-a363-5ba7ccbfe1af req-a0e75c1a-fd2b-40e6-8f41-2ca93e434c06 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:10.984042 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-2f2be1e4-834d-468f-a363-5ba7ccbfe1af req-a0e75c1a-fd2b-40e6-8f41-2ca93e434c06 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:11.001556 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-2f2be1e4-834d-468f-a363-5ba7ccbfe1af req-a0e75c1a-fd2b-40e6-8f41-2ca93e434c06 service nova] Creating event network-changed:3bf14da9-ff0f-4d44-b9b5-dc459021416b for instance 13034131-50e5-4af9-866a-d1886e4f1d1f on hv-cinder-85221 Aug 31 00:27:11.010536 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-2f2be1e4-834d-468f-a363-5ba7ccbfe1af req-a0e75c1a-fd2b-40e6-8f41-2ca93e434c06 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068094 Aug 31 00:27:11.011897 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 377/767] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:11.134931 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-8ac58387-593a-41b4-bdc1-a1ab612358a3 req-8978b001-ecc5-4939-9294-bbf7b3b3820b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f5b45e-d0c7-461b-addb-c046c9cce995", "tag": "7ee0bda6-a8f6-49b1-b97f-b289c4493bf3"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:11.172888 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-8ac58387-593a-41b4-bdc1-a1ab612358a3 req-8978b001-ecc5-4939-9294-bbf7b3b3820b service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:11.174627 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-8ac58387-593a-41b4-bdc1-a1ab612358a3 req-8978b001-ecc5-4939-9294-bbf7b3b3820b service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:11.175444 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-8ac58387-593a-41b4-bdc1-a1ab612358a3 req-8978b001-ecc5-4939-9294-bbf7b3b3820b service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:11.197613 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-8ac58387-593a-41b4-bdc1-a1ab612358a3 req-8978b001-ecc5-4939-9294-bbf7b3b3820b service nova] Creating event network-changed:7ee0bda6-a8f6-49b1-b97f-b289c4493bf3 for instance b3f5b45e-d0c7-461b-addb-c046c9cce995 on hv-cinder-85221 Aug 31 00:27:11.207672 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-8ac58387-593a-41b4-bdc1-a1ab612358a3 req-8978b001-ecc5-4939-9294-bbf7b3b3820b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.602102 Aug 31 00:27:11.209170 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 391/768] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:11.616458 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:11.617340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:11.643740 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:11.645566 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:11.646022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:11.651351 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:11.651830 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:11.668466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:11.982974 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0ce04c92-ae22-4613-9256-736ccbbd76d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:11.984179 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0ce04c92-ae22-4613-9256-736ccbbd76d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:12.006763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0ce04c92-ae22-4613-9256-736ccbbd76d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:12.007924 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0ce04c92-ae22-4613-9256-736ccbbd76d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:12.010742 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0ce04c92-ae22-4613-9256-736ccbbd76d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:12.014274 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0ce04c92-ae22-4613-9256-736ccbbd76d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:12.015135 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0ce04c92-ae22-4613-9256-736ccbbd76d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:12.015939 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0ce04c92-ae22-4613-9256-736ccbbd76d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:13.113701 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0ce04c92-ae22-4613-9256-736ccbbd76d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:13.154058 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0ce04c92-ae22-4613-9256-736ccbbd76d0 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 1.177407 Aug 31 00:27:13.155161 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 392/769] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:11 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:13.173194 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-68450965-9725-4750-b715-3c8d2d6a0c30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:13.179907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-68450965-9725-4750-b715-3c8d2d6a0c30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:13.192695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68450965-9725-4750-b715-3c8d2d6a0c30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:13.196970 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68450965-9725-4750-b715-3c8d2d6a0c30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:13.197664 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68450965-9725-4750-b715-3c8d2d6a0c30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:13.198694 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68450965-9725-4750-b715-3c8d2d6a0c30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:13.199430 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68450965-9725-4750-b715-3c8d2d6a0c30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:13.201415 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-68450965-9725-4750-b715-3c8d2d6a0c30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:13.206703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:13.232285 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:13.245679 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:13.258946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-45192e01-3fb7-487c-bb08-beb09607bd20 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 1.651766 Aug 31 00:27:13.260719 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 378/770] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:11 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:13.280229 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-68450965-9725-4750-b715-3c8d2d6a0c30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.117421 Aug 31 00:27:13.281250 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 393/771] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:27:13 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:13.442160 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a7d1f062-5cc9-440a-9bc1-d1675e010f70 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:13.443549 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-a7d1f062-5cc9-440a-9bc1-d1675e010f70 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:13.484578 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a7d1f062-5cc9-440a-9bc1-d1675e010f70 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:13.488011 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a7d1f062-5cc9-440a-9bc1-d1675e010f70 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:13.489025 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a7d1f062-5cc9-440a-9bc1-d1675e010f70 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:13.492551 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a7d1f062-5cc9-440a-9bc1-d1675e010f70 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:13.494689 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a7d1f062-5cc9-440a-9bc1-d1675e010f70 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:13.498281 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a7d1f062-5cc9-440a-9bc1-d1675e010f70 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:13.587000 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a7d1f062-5cc9-440a-9bc1-d1675e010f70 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments/3742d50c-a0ca-4543-8ecd-b8715fa968c6" status: 200 len: 194 microversion: 2.1 time: 0.157527 Aug 31 00:27:13.597218 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 379/772] 10.222.0.47 () {58 vars in 1413 bytes} [Wed Aug 31 00:27:13 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments/3742d50c-a0ca-4543-8ecd-b8715fa968c6 => generated 194 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:13.606154 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-57421c80-77c3-44d8-9f8e-b43b0fc0e2d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:13.608737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-57421c80-77c3-44d8-9f8e-b43b0fc0e2d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:13.620612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57421c80-77c3-44d8-9f8e-b43b0fc0e2d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:13.623294 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57421c80-77c3-44d8-9f8e-b43b0fc0e2d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:13.627334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57421c80-77c3-44d8-9f8e-b43b0fc0e2d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:13.633460 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57421c80-77c3-44d8-9f8e-b43b0fc0e2d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:13.634480 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57421c80-77c3-44d8-9f8e-b43b0fc0e2d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:13.635232 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57421c80-77c3-44d8-9f8e-b43b0fc0e2d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:13.896842 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-57421c80-77c3-44d8-9f8e-b43b0fc0e2d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lazy-loading 'services' on Instance uuid 5c64bfe1-3a21-410a-8b62-07114788167c {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:27:14.148239 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-57421c80-77c3-44d8-9f8e-b43b0fc0e2d8 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments/3742d50c-a0ca-4543-8ecd-b8715fa968c6" status: 202 len: 0 microversion: 2.1 time: 0.550006 Aug 31 00:27:14.159468 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 394/773] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:27:13 2022] DELETE /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments/3742d50c-a0ca-4543-8ecd-b8715fa968c6 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:27:14.196815 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-0d2e19ab-dcda-43ff-bebb-da31f4562d8c tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:14.198013 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-0d2e19ab-dcda-43ff-bebb-da31f4562d8c tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:14.217923 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0d2e19ab-dcda-43ff-bebb-da31f4562d8c tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:14.222434 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0d2e19ab-dcda-43ff-bebb-da31f4562d8c tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:14.224181 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0d2e19ab-dcda-43ff-bebb-da31f4562d8c tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:14.227408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0d2e19ab-dcda-43ff-bebb-da31f4562d8c tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:14.228952 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0d2e19ab-dcda-43ff-bebb-da31f4562d8c tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:14.229600 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0d2e19ab-dcda-43ff-bebb-da31f4562d8c tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:14.290158 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:14.291316 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:14.304237 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:14.310920 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:14.312342 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:14.315369 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:14.320600 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:14.321483 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:14.965542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-0d2e19ab-dcda-43ff-bebb-da31f4562d8c tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:14.986939 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:14.994965 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-0d2e19ab-dcda-43ff-bebb-da31f4562d8c tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.803401 Aug 31 00:27:14.998379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 380/774] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:14 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:15.043686 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:15.054191 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:15.056440 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9499898c-de27-485a-b8ef-3a41e7942f61 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 0.770266 Aug 31 00:27:15.057282 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 395/775] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:14 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:16.043591 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-be8729c9-1447-42a7-9e7f-0e15dd25e646 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:16.046658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-be8729c9-1447-42a7-9e7f-0e15dd25e646 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:16.061100 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be8729c9-1447-42a7-9e7f-0e15dd25e646 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:16.062271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be8729c9-1447-42a7-9e7f-0e15dd25e646 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:16.063444 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be8729c9-1447-42a7-9e7f-0e15dd25e646 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:16.065291 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be8729c9-1447-42a7-9e7f-0e15dd25e646 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:16.066479 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be8729c9-1447-42a7-9e7f-0e15dd25e646 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:16.068024 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-be8729c9-1447-42a7-9e7f-0e15dd25e646 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:16.097849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:16.099879 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:16.119992 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:16.128123 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:16.129565 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:16.134831 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:16.136168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:16.137236 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:16.542449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-be8729c9-1447-42a7-9e7f-0e15dd25e646 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:16.592433 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-be8729c9-1447-42a7-9e7f-0e15dd25e646 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.553203 Aug 31 00:27:16.596372 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 381/776] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:16 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:16.675864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:16.691079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-efa640cf-5ede-49da-860b-411e4dbb2d1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:16.692251 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-efa640cf-5ede-49da-860b-411e4dbb2d1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:16.702708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:16.706390 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:16.708453 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5108c391-5c76-4020-99b7-ed3970e1881f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 0.617755 Aug 31 00:27:16.710289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-efa640cf-5ede-49da-860b-411e4dbb2d1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:16.711838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-efa640cf-5ede-49da-860b-411e4dbb2d1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:16.713886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-efa640cf-5ede-49da-860b-411e4dbb2d1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:16.714430 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 396/777] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:16 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:16.715223 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-efa640cf-5ede-49da-860b-411e4dbb2d1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:16.717147 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-efa640cf-5ede-49da-860b-411e4dbb2d1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:16.717594 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-efa640cf-5ede-49da-860b-411e4dbb2d1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:16.882623 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-efa640cf-5ede-49da-860b-411e4dbb2d1d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments/d76874bf-bce5-44cb-bff1-224953b8e980" status: 200 len: 194 microversion: 2.1 time: 0.200939 Aug 31 00:27:16.892653 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 382/778] 10.222.0.47 () {58 vars in 1413 bytes} [Wed Aug 31 00:27:16 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments/d76874bf-bce5-44cb-bff1-224953b8e980 => generated 194 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:16.899573 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f954e5af-8696-4e7f-ab97-bd43972a0895 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:16.900513 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f954e5af-8696-4e7f-ab97-bd43972a0895 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:16.915147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f954e5af-8696-4e7f-ab97-bd43972a0895 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:16.916000 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f954e5af-8696-4e7f-ab97-bd43972a0895 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:16.916677 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f954e5af-8696-4e7f-ab97-bd43972a0895 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:16.918032 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f954e5af-8696-4e7f-ab97-bd43972a0895 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:16.918758 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f954e5af-8696-4e7f-ab97-bd43972a0895 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:16.924517 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f954e5af-8696-4e7f-ab97-bd43972a0895 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:17.206470 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:17.219907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-f954e5af-8696-4e7f-ab97-bd43972a0895 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lazy-loading 'services' on Instance uuid 5c64bfe1-3a21-410a-8b62-07114788167c {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:27:17.383446 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f954e5af-8696-4e7f-ab97-bd43972a0895 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments/d76874bf-bce5-44cb-bff1-224953b8e980" status: 202 len: 0 microversion: 2.1 time: 0.488081 Aug 31 00:27:17.384604 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 397/779] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:27:16 2022] DELETE /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments/d76874bf-bce5-44cb-bff1-224953b8e980 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:27:17.638364 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-dadde205-eadd-4883-b8b3-73025a8ddd2a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:17.641192 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-dadde205-eadd-4883-b8b3-73025a8ddd2a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:17.654521 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dadde205-eadd-4883-b8b3-73025a8ddd2a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:17.655785 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dadde205-eadd-4883-b8b3-73025a8ddd2a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:17.656774 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dadde205-eadd-4883-b8b3-73025a8ddd2a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:17.658234 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dadde205-eadd-4883-b8b3-73025a8ddd2a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:17.659261 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dadde205-eadd-4883-b8b3-73025a8ddd2a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:17.660284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-dadde205-eadd-4883-b8b3-73025a8ddd2a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:17.760565 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:17.761450 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:17.789234 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:17.789842 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:17.790302 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:17.791059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:17.791547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:17.792008 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:18.360770 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-dadde205-eadd-4883-b8b3-73025a8ddd2a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:18.380088 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-dadde205-eadd-4883-b8b3-73025a8ddd2a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.751454 Aug 31 00:27:18.388933 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 383/780] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:17 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:18.484693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:18.496605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:18.499044 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:18.501408 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-32397387-6cc4-407a-a73a-0de51521990a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 0.752214 Aug 31 00:27:18.502962 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 398/781] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:17 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:27:19.457883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-33ac5534-334e-4adf-96ce-0b15817df364 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:19.458500 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-33ac5534-334e-4adf-96ce-0b15817df364 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:19.494156 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-33ac5534-334e-4adf-96ce-0b15817df364 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:19.503435 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-33ac5534-334e-4adf-96ce-0b15817df364 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:19.504732 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-33ac5534-334e-4adf-96ce-0b15817df364 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:19.506401 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-33ac5534-334e-4adf-96ce-0b15817df364 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:19.507363 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-33ac5534-334e-4adf-96ce-0b15817df364 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:19.508281 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-33ac5534-334e-4adf-96ce-0b15817df364 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:19.555733 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:19.556872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:19.578022 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:19.591899 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:19.599038 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:19.605306 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:19.609586 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:19.620901 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:20.048839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:20.075010 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:20.137146 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:20.148763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f6109b11-bee7-405f-8d67-5b6d26d57810 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 0.600710 Aug 31 00:27:20.156206 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 399/782] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:19 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:20.196127 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1bfae392-2926-4082-a2e6-926133825fd1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:20.218680 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1bfae392-2926-4082-a2e6-926133825fd1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:20.240988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-33ac5534-334e-4adf-96ce-0b15817df364 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:20.252840 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bfae392-2926-4082-a2e6-926133825fd1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:20.259469 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bfae392-2926-4082-a2e6-926133825fd1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:20.260305 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bfae392-2926-4082-a2e6-926133825fd1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:20.261706 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bfae392-2926-4082-a2e6-926133825fd1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:20.262628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bfae392-2926-4082-a2e6-926133825fd1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:20.269586 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1bfae392-2926-4082-a2e6-926133825fd1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:20.272546 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-33ac5534-334e-4adf-96ce-0b15817df364 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 0.849808 Aug 31 00:27:20.277398 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 384/783] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:19 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:20.371011 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1bfae392-2926-4082-a2e6-926133825fd1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.214882 Aug 31 00:27:20.401150 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 400/784] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:27:20 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments => generated 25 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:27:20.641839 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-16d98948-69c7-464f-b899-03310181acdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:20.645883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-16d98948-69c7-464f-b899-03310181acdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:20.671923 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-16d98948-69c7-464f-b899-03310181acdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:20.672827 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-16d98948-69c7-464f-b899-03310181acdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:20.673599 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-16d98948-69c7-464f-b899-03310181acdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:20.674880 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-16d98948-69c7-464f-b899-03310181acdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:20.675691 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-16d98948-69c7-464f-b899-03310181acdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:20.676578 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-16d98948-69c7-464f-b899-03310181acdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:20.825240 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-16d98948-69c7-464f-b899-03310181acdd tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.194492 Aug 31 00:27:20.826055 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 385/785] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:27:20 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c/os-volume_attachments => generated 25 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:27:20.956120 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-fa166cfe-e28c-4dda-92cc-0e192fb28a78 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:20.957203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-fa166cfe-e28c-4dda-92cc-0e192fb28a78 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:20.963942 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa166cfe-e28c-4dda-92cc-0e192fb28a78 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:20.964491 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa166cfe-e28c-4dda-92cc-0e192fb28a78 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:20.964932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa166cfe-e28c-4dda-92cc-0e192fb28a78 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:20.965684 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa166cfe-e28c-4dda-92cc-0e192fb28a78 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:20.966661 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa166cfe-e28c-4dda-92cc-0e192fb28a78 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:20.967209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fa166cfe-e28c-4dda-92cc-0e192fb28a78 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:21.001035 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-fa166cfe-e28c-4dda-92cc-0e192fb28a78 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Going to try to terminate instance {{(pid=127118) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:27:21.176481 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:21.177564 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:21.196784 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:21.202492 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:21.203404 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:21.205896 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:21.209610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:21.212727 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:21.221215 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-fa166cfe-e28c-4dda-92cc-0e192fb28a78 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 204 len: 0 microversion: 2.1 time: 0.268355 Aug 31 00:27:21.226456 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 401/786] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:27:20 2022] DELETE /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:27:21.256568 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-541db54e-33d4-49af-b78f-afddba4e239b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:21.260601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-541db54e-33d4-49af-b78f-afddba4e239b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:21.306920 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-541db54e-33d4-49af-b78f-afddba4e239b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:21.307959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-541db54e-33d4-49af-b78f-afddba4e239b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:21.308899 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-541db54e-33d4-49af-b78f-afddba4e239b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:21.311916 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-541db54e-33d4-49af-b78f-afddba4e239b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:21.316988 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-541db54e-33d4-49af-b78f-afddba4e239b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:21.324852 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-541db54e-33d4-49af-b78f-afddba4e239b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:21.616921 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:21.633307 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:21.635045 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:21.638263 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b9582c31-e4d6-4672-950b-cfe5e49f6cd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 0.465783 Aug 31 00:27:21.640562 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 386/787] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:21 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:21.645486 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-774dc7c3-8b5a-4fe4-925a-517ac55da830 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:21.646503 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-774dc7c3-8b5a-4fe4-925a-517ac55da830 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:21.664421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-774dc7c3-8b5a-4fe4-925a-517ac55da830 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:21.665035 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-774dc7c3-8b5a-4fe4-925a-517ac55da830 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:21.665339 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-774dc7c3-8b5a-4fe4-925a-517ac55da830 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:21.667390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-774dc7c3-8b5a-4fe4-925a-517ac55da830 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:21.667390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-774dc7c3-8b5a-4fe4-925a-517ac55da830 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:21.669703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-774dc7c3-8b5a-4fe4-925a-517ac55da830 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:21.753838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=100 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:21.773304 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-541db54e-33d4-49af-b78f-afddba4e239b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:21.820067 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-541db54e-33d4-49af-b78f-afddba4e239b tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1674 microversion: 2.1 time: 0.584185 Aug 31 00:27:21.832181 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 402/788] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:21 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1674 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:21.878698 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-b1c794ed-a184-4d50-b2e9-af6e7eabd08a req-e712e355-d36d-4244-b7a5-8cc867c252c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95e1f70-6a63-40b2-a053-4b043f6b1ffa", "name": "network-vif-unplugged", "status": "completed", "tag": "c156e592-123d-470f-843d-661d21c8d777"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:21.918167 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-b1c794ed-a184-4d50-b2e9-af6e7eabd08a req-e712e355-d36d-4244-b7a5-8cc867c252c6 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:21.920196 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-b1c794ed-a184-4d50-b2e9-af6e7eabd08a req-e712e355-d36d-4244-b7a5-8cc867c252c6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:21.921858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-b1c794ed-a184-4d50-b2e9-af6e7eabd08a req-e712e355-d36d-4244-b7a5-8cc867c252c6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:21.952251 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.compute.server_external_events [req-b1c794ed-a184-4d50-b2e9-af6e7eabd08a req-e712e355-d36d-4244-b7a5-8cc867c252c6 service nova] Unable to find a host for instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa. Dropping event network-vif-unplugged {{(pid=127118) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 00:27:21.953138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-b1c794ed-a184-4d50-b2e9-af6e7eabd08a req-e712e355-d36d-4244-b7a5-8cc867c252c6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.129824 Aug 31 00:27:21.953766 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 403/789] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 131 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 00:27:21.992386 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-774dc7c3-8b5a-4fe4-925a-517ac55da830 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:22.009286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-774dc7c3-8b5a-4fe4-925a-517ac55da830 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1507 microversion: 2.1 time: 0.367292 Aug 31 00:27:22.019671 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 387/790] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:21 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:22.046739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3632a2c4-7672-4196-96c0-319c3591e059 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:22.047377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3632a2c4-7672-4196-96c0-319c3591e059 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:22.054969 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3632a2c4-7672-4196-96c0-319c3591e059 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:22.055768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3632a2c4-7672-4196-96c0-319c3591e059 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:22.056437 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3632a2c4-7672-4196-96c0-319c3591e059 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:22.057732 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3632a2c4-7672-4196-96c0-319c3591e059 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:22.058615 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3632a2c4-7672-4196-96c0-319c3591e059 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:22.059214 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3632a2c4-7672-4196-96c0-319c3591e059 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:22.095720 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3632a2c4-7672-4196-96c0-319c3591e059 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127118) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 00:27:22.182801 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3632a2c4-7672-4196-96c0-319c3591e059 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "POST /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.142229 Aug 31 00:27:22.188652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 404/791] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:27:22 2022] POST /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:27:22.193894 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-bbe481b2-7908-40ad-8d39-141589677e7e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:22.194631 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-bbe481b2-7908-40ad-8d39-141589677e7e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:22.207252 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bbe481b2-7908-40ad-8d39-141589677e7e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:22.210411 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bbe481b2-7908-40ad-8d39-141589677e7e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:22.218225 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bbe481b2-7908-40ad-8d39-141589677e7e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:22.219287 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bbe481b2-7908-40ad-8d39-141589677e7e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:22.220056 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bbe481b2-7908-40ad-8d39-141589677e7e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:22.220637 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bbe481b2-7908-40ad-8d39-141589677e7e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:22.480701 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-bbe481b2-7908-40ad-8d39-141589677e7e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:22.521504 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-bbe481b2-7908-40ad-8d39-141589677e7e tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1515 microversion: 2.1 time: 0.331593 Aug 31 00:27:22.524259 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 388/792] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:22 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1515 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:22.705340 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:22.706452 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:22.729348 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:22.732256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:22.732256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:22.733109 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:22.733908 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:22.734643 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:22.850070 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e2394097-8f7b-494f-8026-c70b6c29f3d1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:22.852517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e2394097-8f7b-494f-8026-c70b6c29f3d1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:22.861907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e2394097-8f7b-494f-8026-c70b6c29f3d1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:22.862901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e2394097-8f7b-494f-8026-c70b6c29f3d1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:22.863608 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e2394097-8f7b-494f-8026-c70b6c29f3d1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:22.864623 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e2394097-8f7b-494f-8026-c70b6c29f3d1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:22.867265 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e2394097-8f7b-494f-8026-c70b6c29f3d1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:22.867973 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e2394097-8f7b-494f-8026-c70b6c29f3d1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:23.552434 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e2394097-8f7b-494f-8026-c70b6c29f3d1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:23.564961 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e2394097-8f7b-494f-8026-c70b6c29f3d1 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1674 microversion: 2.1 time: 0.720559 Aug 31 00:27:23.565568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 389/793] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:22 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1674 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:23.583613 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-607bd976-1ff3-4f93-a40c-cbcdd6dfa837 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:23.585857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-607bd976-1ff3-4f93-a40c-cbcdd6dfa837 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:23.598584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:23.609409 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-607bd976-1ff3-4f93-a40c-cbcdd6dfa837 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:23.610323 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-607bd976-1ff3-4f93-a40c-cbcdd6dfa837 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:23.610898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-607bd976-1ff3-4f93-a40c-cbcdd6dfa837 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:23.615118 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-607bd976-1ff3-4f93-a40c-cbcdd6dfa837 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:23.615679 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-607bd976-1ff3-4f93-a40c-cbcdd6dfa837 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:23.616144 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-607bd976-1ff3-4f93-a40c-cbcdd6dfa837 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:23.629946 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:23.631861 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:23.634039 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-698bf93c-56f3-4798-968e-fd2dd314f490 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 0.950804 Aug 31 00:27:23.637166 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 405/794] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:22 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:24.613071 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e3bae194-7cf9-45a4-af94-00df40c4bf36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:24.615974 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e3bae194-7cf9-45a4-af94-00df40c4bf36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:24.628669 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3bae194-7cf9-45a4-af94-00df40c4bf36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:24.633009 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3bae194-7cf9-45a4-af94-00df40c4bf36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:24.633849 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3bae194-7cf9-45a4-af94-00df40c4bf36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:24.634918 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3bae194-7cf9-45a4-af94-00df40c4bf36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:24.635642 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3bae194-7cf9-45a4-af94-00df40c4bf36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:24.636694 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e3bae194-7cf9-45a4-af94-00df40c4bf36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:24.659204 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-607bd976-1ff3-4f93-a40c-cbcdd6dfa837 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:24.752024 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-607bd976-1ff3-4f93-a40c-cbcdd6dfa837 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1515 microversion: 2.1 time: 1.185019 Aug 31 00:27:24.762341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 390/795] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:23 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1515 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:24.830192 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:24.844243 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:24.912551 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:24.922173 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:24.924531 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:24.929347 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:24.936471 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:24.941553 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:25.024345 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e3bae194-7cf9-45a4-af94-00df40c4bf36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:25.034371 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e3bae194-7cf9-45a4-af94-00df40c4bf36 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1674 microversion: 2.1 time: 0.425921 Aug 31 00:27:25.056111 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 406/796] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:24 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1674 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:25.783717 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-5845e1c1-fd95-4abb-9604-74b59a356af3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:25.787015 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-5845e1c1-fd95-4abb-9604-74b59a356af3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:25.811217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5845e1c1-fd95-4abb-9604-74b59a356af3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:25.820361 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5845e1c1-fd95-4abb-9604-74b59a356af3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:25.821125 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5845e1c1-fd95-4abb-9604-74b59a356af3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:25.822402 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5845e1c1-fd95-4abb-9604-74b59a356af3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:25.823196 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5845e1c1-fd95-4abb-9604-74b59a356af3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:25.823936 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-5845e1c1-fd95-4abb-9604-74b59a356af3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:26.903308 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:26.958739 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:26.972481 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:26.985625 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b76b1991-9933-4ed7-800f-c255c757de38 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 2.212251 Aug 31 00:27:27.009336 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 391/797] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:24 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 2246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:27.054700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b0f5970e-2e49-4509-a00f-7a31eb363360 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:27.056350 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b0f5970e-2e49-4509-a00f-7a31eb363360 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:27.091790 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b0f5970e-2e49-4509-a00f-7a31eb363360 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:27.093056 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b0f5970e-2e49-4509-a00f-7a31eb363360 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:27.094102 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b0f5970e-2e49-4509-a00f-7a31eb363360 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:27.097317 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b0f5970e-2e49-4509-a00f-7a31eb363360 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:27.098527 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b0f5970e-2e49-4509-a00f-7a31eb363360 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:27.105147 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b0f5970e-2e49-4509-a00f-7a31eb363360 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:27.177528 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-5845e1c1-fd95-4abb-9604-74b59a356af3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:27.226137 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-5845e1c1-fd95-4abb-9604-74b59a356af3 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1573 microversion: 2.1 time: 1.444056 Aug 31 00:27:27.228532 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 407/798] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:25 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1573 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:28.058131 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:28.059226 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:28.097148 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:28.098271 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:28.099020 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:28.103995 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:28.114574 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:28.116982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:28.206979 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b0f5970e-2e49-4509-a00f-7a31eb363360 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:28.234218 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b0f5970e-2e49-4509-a00f-7a31eb363360 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1674 microversion: 2.1 time: 1.195339 Aug 31 00:27:28.239398 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 392/799] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:27 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1674 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:28.275347 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1cfe1c0d-a866-42cf-ae67-97604fa38175 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:28.285115 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1cfe1c0d-a866-42cf-ae67-97604fa38175 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:28.321436 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cfe1c0d-a866-42cf-ae67-97604fa38175 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:28.329400 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cfe1c0d-a866-42cf-ae67-97604fa38175 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:28.332890 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cfe1c0d-a866-42cf-ae67-97604fa38175 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:28.334644 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cfe1c0d-a866-42cf-ae67-97604fa38175 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:28.335727 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cfe1c0d-a866-42cf-ae67-97604fa38175 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:28.340092 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1cfe1c0d-a866-42cf-ae67-97604fa38175 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:29.105717 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:29.160015 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:29.175813 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:29.178869 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d224c918-8270-4428-ba07-cfa7b9b0899c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1740 microversion: 2.20 time: 1.139492 Aug 31 00:27:29.195530 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 408/800] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:28 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1740 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:29.294682 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-dd05e3f8-6406-46be-950f-e9ade1f87056 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:29.304233 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-dd05e3f8-6406-46be-950f-e9ade1f87056 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:29.350398 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd05e3f8-6406-46be-950f-e9ade1f87056 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:29.356982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd05e3f8-6406-46be-950f-e9ade1f87056 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:29.359853 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd05e3f8-6406-46be-950f-e9ade1f87056 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:29.361537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd05e3f8-6406-46be-950f-e9ade1f87056 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:29.368057 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd05e3f8-6406-46be-950f-e9ade1f87056 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:29.369477 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-dd05e3f8-6406-46be-950f-e9ade1f87056 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:29.540967 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1cfe1c0d-a866-42cf-ae67-97604fa38175 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:29.562252 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1cfe1c0d-a866-42cf-ae67-97604fa38175 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1573 microversion: 2.1 time: 1.303325 Aug 31 00:27:29.565339 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 393/801] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:28 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1573 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:29.579096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-74596c11-2b7f-4763-80a5-7fa447c3372d req-6d709af7-3f79-4f78-bd33-9acd82ad9dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c64bfe1-3a21-410a-8b62-07114788167c", "name": "network-vif-deleted", "tag": "9b0b524b-6589-4a3f-ad55-3ea2433fdd58"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:29.636531 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-74596c11-2b7f-4763-80a5-7fa447c3372d req-6d709af7-3f79-4f78-bd33-9acd82ad9dca service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:29.636856 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-74596c11-2b7f-4763-80a5-7fa447c3372d req-6d709af7-3f79-4f78-bd33-9acd82ad9dca service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:29.640584 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-74596c11-2b7f-4763-80a5-7fa447c3372d req-6d709af7-3f79-4f78-bd33-9acd82ad9dca service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:29.705389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-74596c11-2b7f-4763-80a5-7fa447c3372d req-6d709af7-3f79-4f78-bd33-9acd82ad9dca service nova] Creating event network-vif-deleted:9b0b524b-6589-4a3f-ad55-3ea2433fdd58 for instance 5c64bfe1-3a21-410a-8b62-07114788167c on hv-cinder-85221 Aug 31 00:27:29.712963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-74596c11-2b7f-4763-80a5-7fa447c3372d req-6d709af7-3f79-4f78-bd33-9acd82ad9dca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143643 Aug 31 00:27:29.714237 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 394/802] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:29.789071 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-dd05e3f8-6406-46be-950f-e9ade1f87056 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:29.811789 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-dd05e3f8-6406-46be-950f-e9ade1f87056 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1323 microversion: 2.1 time: 0.540523 Aug 31 00:27:29.817039 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 409/803] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:29 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1323 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:30.230616 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:30.232961 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:30.261550 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:30.263377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:30.264468 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:30.266081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:30.268851 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:30.269998 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:30.592391 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9902fb50-9fd9-40c5-94a0-697e459326ca tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:30.593609 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9902fb50-9fd9-40c5-94a0-697e459326ca tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:30.619971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9902fb50-9fd9-40c5-94a0-697e459326ca tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:30.632779 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:30.638760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9902fb50-9fd9-40c5-94a0-697e459326ca tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:30.640042 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9902fb50-9fd9-40c5-94a0-697e459326ca tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:30.644417 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9902fb50-9fd9-40c5-94a0-697e459326ca tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:30.645613 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9902fb50-9fd9-40c5-94a0-697e459326ca tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:30.655406 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9902fb50-9fd9-40c5-94a0-697e459326ca tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:30.709127 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:30.723585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:30.725920 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8d23c4ba-7e82-44ea-8ffd-6cae3288176a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1722 microversion: 2.20 time: 0.501200 Aug 31 00:27:30.736472 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 395/804] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:30 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1722 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:27:30.856998 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:30.858414 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:30.912674 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:30.913623 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:30.918142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:30.919600 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:30.927333 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:30.948645 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:31.061237 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:31.062214 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:31.064837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:31.065628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lazy-loading 'fault' on Instance uuid 5c64bfe1-3a21-410a-8b62-07114788167c {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:27:31.517185 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc018a253e0a4b0bb96097ce4cc72c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d71e648b9ff42fb8b29beabe01a5512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:31.543738 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-330a5add-8a1e-4d51-8a1e-a44dcb3a3a30 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 200 len: 1328 microversion: 2.1 time: 0.706019 Aug 31 00:27:31.550372 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 396/805] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:30 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 1328 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:31.601209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9902fb50-9fd9-40c5-94a0-697e459326ca tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:31.647029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9902fb50-9fd9-40c5-94a0-697e459326ca tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1573 microversion: 2.1 time: 1.062169 Aug 31 00:27:31.652622 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 410/806] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:30 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1573 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:31.755181 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:31.756104 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:31.776546 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:31.778389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:31.785042 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:31.787600 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:31.788971 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:31.793339 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:32.445295 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:32.462778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:32.467553 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:32.471908 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ed3027fe-09b0-4e1e-9007-3f6cc93a9339 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1722 microversion: 2.20 time: 0.718507 Aug 31 00:27:32.475936 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 397/807] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:31 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1722 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:32.602964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:32.607288 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:32.640382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:32.641827 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:32.643009 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:32.644735 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:32.645984 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:32.647332 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:32.688898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-23bdee30-50fe-4a01-9721-2ee8abb81bb7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:32.689527 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-23bdee30-50fe-4a01-9721-2ee8abb81bb7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:32.698723 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] HTTP exception thrown: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:32.700951 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-23bdee30-50fe-4a01-9721-2ee8abb81bb7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:32.701443 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-23bdee30-50fe-4a01-9721-2ee8abb81bb7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Request method failure captured: Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c HTTP/1.1 Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlDf__9VhHXs1q6CC1yYxgwW6u6FioC34E8PhByXIKOjcmp5yz-avpA1e44tg3Ll4MuGFLnIMNZVBGyKqmYhChFVvXpu9L2-UZPolRYOiL3dL9KjQ85K_ud4qRGvS6wSdcB8yX78Pwa3oQ9CYYoeW-uCYfJ5tyPVksnhqzMBq5yco0 Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:27:32.703462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d71e648b9ff42fb8b29beabe01a5512"}]}] Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: bc018a253e0a4b0bb96097ce4cc72c21 Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:32.706144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '5c64bfe1-3a21-410a-8b62-07114788167c'} Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:32.707228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:32.712203 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:32.723944 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-23bdee30-50fe-4a01-9721-2ee8abb81bb7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:32.723944 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-23bdee30-50fe-4a01-9721-2ee8abb81bb7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:32.723944 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-23bdee30-50fe-4a01-9721-2ee8abb81bb7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:32.723944 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-23bdee30-50fe-4a01-9721-2ee8abb81bb7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:32.724968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Returning 404 to user: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:32.724968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3b7df966-0e08-4fc1-b1d7-80f201822a03 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 404 len: 111 microversion: 2.1 time: 0.132972 Aug 31 00:27:32.727004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 411/808] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:32 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:27:32.762204 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b1e4eb97-77df-4cb1-a40b-285bdd7daec7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '.version_select at 0x7f1a3a7afb80>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:32.813739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b1e4eb97-77df-4cb1-a40b-285bdd7daec7 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013446356" status: 202 len: 0 microversion: 2.1 time: 0.078759 Aug 31 00:27:32.818106 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 412/809] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Aug 31 00:27:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013446356 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:27:32.943890 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-23bdee30-50fe-4a01-9721-2ee8abb81bb7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:32.973052 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-23bdee30-50fe-4a01-9721-2ee8abb81bb7 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1573 microversion: 2.1 time: 0.288964 Aug 31 00:27:32.976634 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 398/810] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:32 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1573 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:33.171648 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-7018d105-1a49-41f8-b1ae-dbec2ce9d010 req-d27f20fb-ebd6-4636-81be-c4f7205f704f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698d47ed-0a7a-4601-87a9-beb0597d3045", "name": "network-vif-unplugged", "status": "completed", "tag": "9e1236d0-86cd-45da-a9dc-878f6a1707a4"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:33.186636 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-7018d105-1a49-41f8-b1ae-dbec2ce9d010 req-d27f20fb-ebd6-4636-81be-c4f7205f704f service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:33.187023 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-7018d105-1a49-41f8-b1ae-dbec2ce9d010 req-d27f20fb-ebd6-4636-81be-c4f7205f704f service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:33.194868 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-7018d105-1a49-41f8-b1ae-dbec2ce9d010 req-d27f20fb-ebd6-4636-81be-c4f7205f704f service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:33.233108 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-7018d105-1a49-41f8-b1ae-dbec2ce9d010 req-d27f20fb-ebd6-4636-81be-c4f7205f704f service nova] Creating event network-vif-unplugged:9e1236d0-86cd-45da-a9dc-878f6a1707a4 for instance 698d47ed-0a7a-4601-87a9-beb0597d3045 on hv-cinder-85221 Aug 31 00:27:33.246667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-7018d105-1a49-41f8-b1ae-dbec2ce9d010 req-d27f20fb-ebd6-4636-81be-c4f7205f704f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077862 Aug 31 00:27:33.248852 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 413/811] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:27:33.532612 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:33.537740 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:33.568752 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:33.569861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:33.570654 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:33.587991 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:33.590215 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:33.591628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:34.000547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-900f83a9-fb5b-4485-833d-40f78be528d1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:34.001835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-900f83a9-fb5b-4485-833d-40f78be528d1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:34.017711 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-900f83a9-fb5b-4485-833d-40f78be528d1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:34.019051 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-900f83a9-fb5b-4485-833d-40f78be528d1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:34.020193 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-900f83a9-fb5b-4485-833d-40f78be528d1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:34.021924 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-900f83a9-fb5b-4485-833d-40f78be528d1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:34.023437 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-900f83a9-fb5b-4485-833d-40f78be528d1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:34.024577 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-900f83a9-fb5b-4485-833d-40f78be528d1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:34.033922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:34.048669 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:34.071843 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:34.074178 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:34.075795 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5bf64300-1e2f-4ebe-a5ac-54468018a51c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1722 microversion: 2.20 time: 0.567250 Aug 31 00:27:34.081307 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 399/812] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:33 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1722 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:34.452085 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-900f83a9-fb5b-4485-833d-40f78be528d1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:34.472554 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-900f83a9-fb5b-4485-833d-40f78be528d1 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1573 microversion: 2.1 time: 0.478511 Aug 31 00:27:34.490892 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 414/813] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:33 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1573 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:35.129954 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:35.130563 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:35.138353 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:35.139137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:35.139307 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:35.140147 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:35.145059 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:35.148929 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:35.384337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:35.411010 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:35.422170 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:35.425179 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-70da2729-3351-490c-bde9-eb496c09e79c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1725 microversion: 2.20 time: 0.303153 Aug 31 00:27:35.440989 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 400/814] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:35 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:35.474377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f05d78c8-4020-4d42-80ab-758f367062fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70c846e9-aeda-464c-9541-961880f7c82d"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:35.478673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f05d78c8-4020-4d42-80ab-758f367062fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:35.504949 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f05d78c8-4020-4d42-80ab-758f367062fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:35.505451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f05d78c8-4020-4d42-80ab-758f367062fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:35.505884 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f05d78c8-4020-4d42-80ab-758f367062fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:35.506640 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f05d78c8-4020-4d42-80ab-758f367062fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:35.507063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f05d78c8-4020-4d42-80ab-758f367062fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:35.507488 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f05d78c8-4020-4d42-80ab-758f367062fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:35.522733 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e5858027-64d0-4636-bc2c-adf9c4e0a612 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:35.523655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e5858027-64d0-4636-bc2c-adf9c4e0a612 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:35.536542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5858027-64d0-4636-bc2c-adf9c4e0a612 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:35.537626 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5858027-64d0-4636-bc2c-adf9c4e0a612 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:35.538209 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5858027-64d0-4636-bc2c-adf9c4e0a612 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:35.540979 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5858027-64d0-4636-bc2c-adf9c4e0a612 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:35.541813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5858027-64d0-4636-bc2c-adf9c4e0a612 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:35.542686 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5858027-64d0-4636-bc2c-adf9c4e0a612 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:35.854743 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e5858027-64d0-4636-bc2c-adf9c4e0a612 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:35.870775 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e5858027-64d0-4636-bc2c-adf9c4e0a612 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1573 microversion: 2.1 time: 0.355796 Aug 31 00:27:35.874481 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 401/815] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:35 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1573 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:36.179444 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f05d78c8-4020-4d42-80ab-758f367062fd tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "POST /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.712767 Aug 31 00:27:36.181002 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 415/816] 10.222.0.47 () {62 vars in 1364 bytes} [Wed Aug 31 00:27:35 2022] POST /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/os-volume_attachments => generated 188 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:27:36.455740 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-99f35624-91f4-48ad-b3f7-9e76a93d84e7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:36.457472 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-99f35624-91f4-48ad-b3f7-9e76a93d84e7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:36.458264 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=62 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:36.469966 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f35624-91f4-48ad-b3f7-9e76a93d84e7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:36.470793 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f35624-91f4-48ad-b3f7-9e76a93d84e7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:36.471595 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f35624-91f4-48ad-b3f7-9e76a93d84e7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:36.473029 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f35624-91f4-48ad-b3f7-9e76a93d84e7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:36.473718 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f35624-91f4-48ad-b3f7-9e76a93d84e7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:36.474581 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f35624-91f4-48ad-b3f7-9e76a93d84e7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:36.912964 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e07e62af-74de-4830-bc00-9656d5667265 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:36.915268 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e07e62af-74de-4830-bc00-9656d5667265 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:36.936351 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:36.943356 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e07e62af-74de-4830-bc00-9656d5667265 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:36.944271 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e07e62af-74de-4830-bc00-9656d5667265 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:36.949088 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e07e62af-74de-4830-bc00-9656d5667265 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:36.957138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e07e62af-74de-4830-bc00-9656d5667265 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:36.957993 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e07e62af-74de-4830-bc00-9656d5667265 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:36.962430 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e07e62af-74de-4830-bc00-9656d5667265 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:36.973018 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-99f35624-91f4-48ad-b3f7-9e76a93d84e7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "DELETE /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/os-volume_attachments/70c846e9-aeda-464c-9541-961880f7c82d" status: 202 len: 0 microversion: 2.20 time: 0.521914 Aug 31 00:27:36.974485 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 402/817] 10.222.0.47 () {60 vars in 1457 bytes} [Wed Aug 31 00:27:36 2022] DELETE /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/os-volume_attachments/70c846e9-aeda-464c-9541-961880f7c82d => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:27:37.185891 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-df5ad999-b3bf-4b1d-ba99-1fff0c361403 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:37.186490 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-df5ad999-b3bf-4b1d-ba99-1fff0c361403 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:37.199582 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5ad999-b3bf-4b1d-ba99-1fff0c361403 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.199582 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5ad999-b3bf-4b1d-ba99-1fff0c361403 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.201585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5ad999-b3bf-4b1d-ba99-1fff0c361403 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.211475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5ad999-b3bf-4b1d-ba99-1fff0c361403 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.212296 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5ad999-b3bf-4b1d-ba99-1fff0c361403 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.212549 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5ad999-b3bf-4b1d-ba99-1fff0c361403 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.313740 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-df5ad999-b3bf-4b1d-ba99-1fff0c361403 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127117) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 00:27:37.429777 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e07e62af-74de-4830-bc00-9656d5667265 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:37.443343 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e07e62af-74de-4830-bc00-9656d5667265 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1573 microversion: 2.1 time: 0.549736 Aug 31 00:27:37.444563 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 416/818] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:36 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1573 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:37.471877 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:37.472641 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:37.487278 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.492335 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.501385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.502802 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.509547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.511725 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.526539 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-df5ad999-b3bf-4b1d-ba99-1fff0c361403 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "POST /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/action" status: 202 len: 0 microversion: 2.20 time: 0.345059 Aug 31 00:27:37.530610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 403/819] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 31 00:27:37 2022] POST /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:27:37.562284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:37.564290 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] HTTP exception thrown: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:37.565827 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Request method failure captured: Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: DELETE /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c HTTP/1.1 Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlDf__9VhHXs1q6CC1yYxgwW6u6FioC34E8PhByXIKOjcmp5yz-avpA1e44tg3Ll4MuGFLnIMNZVBGyKqmYhChFVvXpu9L2-UZPolRYOiL3dL9KjQ85K_ud4qRGvS6wSdcB8yX78Pwa3oQ9CYYoeW-uCYfJ5tyPVksnhqzMBq5yco0 Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:27:37.568089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d71e648b9ff42fb8b29beabe01a5512"}]}] Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: bc018a253e0a4b0bb96097ce4cc72c21 Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:37.569702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '5c64bfe1-3a21-410a-8b62-07114788167c'} Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:37.570512 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:37.571797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:37.577159 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Returning 404 to user: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:37.581210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ce33940a-6986-4e7e-9493-863bc2bfef97 tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 404 len: 111 microversion: 2.1 time: 0.113463 Aug 31 00:27:37.582895 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 417/820] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:27:37 2022] DELETE /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:27:37.596236 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.597299 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:37.599632 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 5c64bfe1-3a21-410a-8b62-07114788167c] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:37.608142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.609843 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.611872 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.613072 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.614137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.621369 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.636651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.638594 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.641470 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.643835 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.644958 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.726420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] HTTP exception thrown: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Request method failure captured: Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c HTTP/1.1 Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlDf__9VhHXs1q6CC1yYxgwW6u6FioC34E8PhByXIKOjcmp5yz-avpA1e44tg3Ll4MuGFLnIMNZVBGyKqmYhChFVvXpu9L2-UZPolRYOiL3dL9KjQ85K_ud4qRGvS6wSdcB8yX78Pwa3oQ9CYYoeW-uCYfJ5tyPVksnhqzMBq5yco0 Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:27:37.730605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d71e648b9ff42fb8b29beabe01a5512"}]}] Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: bc018a253e0a4b0bb96097ce4cc72c21 Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:37.734178 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '5c64bfe1-3a21-410a-8b62-07114788167c'} Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:37.735814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. Aug 31 00:27:37.738639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:37.750232 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Returning 404 to user: Instance 5c64bfe1-3a21-410a-8b62-07114788167c could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:37.750232 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e0f8b9a7-8e6c-43f6-aba6-48f85c4b3c7d tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c" status: 404 len: 111 microversion: 2.1 time: 0.154295 Aug 31 00:27:37.751218 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 418/821] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:37 2022] GET /compute/v2.1/servers/5c64bfe1-3a21-410a-8b62-07114788167c => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:27:38.084990 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:38.097354 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:38.099638 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:38.101154 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9baa1614-40ce-411c-8833-4b369de81ddc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1673 microversion: 2.20 time: 0.561742 Aug 31 00:27:38.102076 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 404/822] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:37 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1673 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:38.496571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-16114270-cb2b-4dca-8b00-1aee69e1118d tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:38.501480 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-16114270-cb2b-4dca-8b00-1aee69e1118d tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:38.518233 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:38.547012 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-16114270-cb2b-4dca-8b00-1aee69e1118d tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:38.548387 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-16114270-cb2b-4dca-8b00-1aee69e1118d tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:38.549349 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-16114270-cb2b-4dca-8b00-1aee69e1118d tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:38.551089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-16114270-cb2b-4dca-8b00-1aee69e1118d tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:38.552107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-16114270-cb2b-4dca-8b00-1aee69e1118d tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:38.553080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-16114270-cb2b-4dca-8b00-1aee69e1118d tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:38.860913 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-16114270-cb2b-4dca-8b00-1aee69e1118d tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:38.870244 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-16114270-cb2b-4dca-8b00-1aee69e1118d tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1573 microversion: 2.1 time: 0.381252 Aug 31 00:27:38.873230 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 419/823] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:38 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1573 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:39.158343 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:39.158975 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:39.183571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:39.184117 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:39.193958 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.195283 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.195782 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:39.196630 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.197108 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.197575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:39.221184 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.221685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.222130 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:39.222881 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.234676 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.234982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:39.302639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] HTTP exception thrown: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Request method failure captured: Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: DELETE /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e HTTP/1.1 Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlDf__9VhHXs1q6CC1yYxgwW6u6FioC34E8PhByXIKOjcmp5yz-avpA1e44tg3Ll4MuGFLnIMNZVBGyKqmYhChFVvXpu9L2-UZPolRYOiL3dL9KjQ85K_ud4qRGvS6wSdcB8yX78Pwa3oQ9CYYoeW-uCYfJ5tyPVksnhqzMBq5yco0 Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:27:39.304329 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d71e648b9ff42fb8b29beabe01a5512"}]}] Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: bc018a253e0a4b0bb96097ce4cc72c21 Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:27:39.307331 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '1e22ddf8-4065-4933-a8db-68b53f82a42e'} Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:39.309228 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:27:39.311591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.314395 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Returning 404 to user: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:39.314395 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-abd31dc7-db4b-42dc-8e3a-f97dab83ffda tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 404 len: 111 microversion: 2.1 time: 0.136013 Aug 31 00:27:39.315858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 420/824] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:27:39 2022] DELETE /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:27:39.335864 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:39.339806 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] [instance: 1e22ddf8-4065-4933-a8db-68b53f82a42e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:39.363533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.364381 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.364845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:39.365577 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.366048 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.366476 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:39.430899 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] HTTP exception thrown: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Request method failure captured: Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e HTTP/1.1 Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlDf__9VhHXs1q6CC1yYxgwW6u6FioC34E8PhByXIKOjcmp5yz-avpA1e44tg3Ll4MuGFLnIMNZVBGyKqmYhChFVvXpu9L2-UZPolRYOiL3dL9KjQ85K_ud4qRGvS6wSdcB8yX78Pwa3oQ9CYYoeW-uCYfJ5tyPVksnhqzMBq5yco0 Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:27:39.437420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d71e648b9ff42fb8b29beabe01a5512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d71e648b9ff42fb8b29beabe01a5512"}]}] Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 5d71e648b9ff42fb8b29beabe01a5512 Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeTestJSON-346253535 Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: bc018a253e0a4b0bb96097ce4cc72c21 Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeTestJSON-346253535-project Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:27:39.438845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '1e22ddf8-4065-4933-a8db-68b53f82a42e'} Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:39.439652 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. Aug 31 00:27:39.441076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.443523 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] Returning 404 to user: Instance 1e22ddf8-4065-4933-a8db-68b53f82a42e could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:39.445180 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-81d6ebee-de03-4a97-92e9-6fc7f4fe9f3e tempest-AttachVolumeTestJSON-346253535 tempest-AttachVolumeTestJSON-346253535-project] 10.222.0.47 "GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e" status: 404 len: 111 microversion: 2.1 time: 0.115877 Aug 31 00:27:39.447096 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 421/825] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:39 2022] GET /compute/v2.1/servers/1e22ddf8-4065-4933-a8db-68b53f82a42e => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:27:39.614074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:39.676023 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:39.679366 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:39.692413 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-bf0310ec-3fce-49df-9402-4e4ca96fc1a5 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1673 microversion: 2.20 time: 0.567832 Aug 31 00:27:39.693275 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 405/826] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:39 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1673 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:39.897629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-72166738-102e-4ced-9258-05899d4a4df5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:39.898580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-72166738-102e-4ced-9258-05899d4a4df5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:39.908011 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72166738-102e-4ced-9258-05899d4a4df5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.908915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72166738-102e-4ced-9258-05899d4a4df5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.909572 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72166738-102e-4ced-9258-05899d4a4df5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:39.910531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72166738-102e-4ced-9258-05899d4a4df5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.913782 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72166738-102e-4ced-9258-05899d4a4df5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.914510 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-72166738-102e-4ced-9258-05899d4a4df5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:40.296934 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-72166738-102e-4ced-9258-05899d4a4df5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:40.327984 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-72166738-102e-4ced-9258-05899d4a4df5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1573 microversion: 2.1 time: 0.435210 Aug 31 00:27:40.334946 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 422/827] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:39 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1573 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:40.724097 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:40.725783 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:40.736060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:40.739006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:40.739825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:40.740868 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:40.741769 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:40.742480 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:41.042893 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:41.068566 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:41.070752 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:41.078720 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d5b47946-c764-4452-881e-40fc7cfb28e3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.354564 Aug 31 00:27:41.080090 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 406/828] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:40 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:41.364559 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7c5fa3b2-0a4b-4013-9cd8-c39be26dda55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:41.370687 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7c5fa3b2-0a4b-4013-9cd8-c39be26dda55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:41.438439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c5fa3b2-0a4b-4013-9cd8-c39be26dda55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:41.441163 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c5fa3b2-0a4b-4013-9cd8-c39be26dda55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:41.449862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c5fa3b2-0a4b-4013-9cd8-c39be26dda55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:41.463896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c5fa3b2-0a4b-4013-9cd8-c39be26dda55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:41.466687 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c5fa3b2-0a4b-4013-9cd8-c39be26dda55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:41.467898 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7c5fa3b2-0a4b-4013-9cd8-c39be26dda55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:41.887290 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-a89d1fb6-2b23-484e-b3d8-5ffccc16b9e0 req-aa6e3299-bbc6-4ffe-8dc3-2e525607566a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95e1f70-6a63-40b2-a053-4b043f6b1ffa", "name": "network-vif-plugged", "status": "completed", "tag": "c156e592-123d-470f-843d-661d21c8d777"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:41.937462 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a89d1fb6-2b23-484e-b3d8-5ffccc16b9e0 req-aa6e3299-bbc6-4ffe-8dc3-2e525607566a service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:41.937956 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a89d1fb6-2b23-484e-b3d8-5ffccc16b9e0 req-aa6e3299-bbc6-4ffe-8dc3-2e525607566a service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:41.944423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7c5fa3b2-0a4b-4013-9cd8-c39be26dda55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:41.947126 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-a89d1fb6-2b23-484e-b3d8-5ffccc16b9e0 req-aa6e3299-bbc6-4ffe-8dc3-2e525607566a service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:42.002662 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-a89d1fb6-2b23-484e-b3d8-5ffccc16b9e0 req-aa6e3299-bbc6-4ffe-8dc3-2e525607566a service nova] Creating event network-vif-plugged:c156e592-123d-470f-843d-661d21c8d777 for instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa on hv-cinder-85221 Aug 31 00:27:42.005502 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7c5fa3b2-0a4b-4013-9cd8-c39be26dda55 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1573 microversion: 2.1 time: 0.650569 Aug 31 00:27:42.006698 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 423/829] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:41 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1573 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:42.031464 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-a89d1fb6-2b23-484e-b3d8-5ffccc16b9e0 req-aa6e3299-bbc6-4ffe-8dc3-2e525607566a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148023 Aug 31 00:27:42.032706 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 407/830] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:42.103771 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:42.104659 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:42.126265 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:42.132487 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:42.144780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:42.145869 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:42.158556 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:42.159415 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:42.972124 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:43.024700 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:43.026470 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:43.028720 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-95540bc8-d529-424f-8cae-aa7e69e7bb2b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.928466 Aug 31 00:27:43.030703 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 424/831] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:42 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:43.050959 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cc032a42-181c-4279-b5f1-0deebfe3d28a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:43.052556 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-cc032a42-181c-4279-b5f1-0deebfe3d28a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:43.060449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc032a42-181c-4279-b5f1-0deebfe3d28a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:43.061341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc032a42-181c-4279-b5f1-0deebfe3d28a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:43.062043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc032a42-181c-4279-b5f1-0deebfe3d28a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:43.063012 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc032a42-181c-4279-b5f1-0deebfe3d28a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:43.063764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc032a42-181c-4279-b5f1-0deebfe3d28a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:43.064453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc032a42-181c-4279-b5f1-0deebfe3d28a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:43.495579 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cc032a42-181c-4279-b5f1-0deebfe3d28a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:43.526266 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cc032a42-181c-4279-b5f1-0deebfe3d28a tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1573 microversion: 2.1 time: 0.486230 Aug 31 00:27:43.528048 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 408/832] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:43 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1573 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:44.057731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:44.060664 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:44.096451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:44.096451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:44.096451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:44.098135 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:44.099035 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:44.099800 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:44.582327 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4d342ac6-ce1e-48cb-a3b2-5a405f2cc6d9 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:44.603480 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:44.607676 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4d342ac6-ce1e-48cb-a3b2-5a405f2cc6d9 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:44.662285 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:44.709087 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d342ac6-ce1e-48cb-a3b2-5a405f2cc6d9 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:44.713147 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d342ac6-ce1e-48cb-a3b2-5a405f2cc6d9 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:44.714533 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d342ac6-ce1e-48cb-a3b2-5a405f2cc6d9 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:44.719269 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:44.720407 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d342ac6-ce1e-48cb-a3b2-5a405f2cc6d9 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:44.723776 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d342ac6-ce1e-48cb-a3b2-5a405f2cc6d9 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:44.724602 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4d342ac6-ce1e-48cb-a3b2-5a405f2cc6d9 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:44.725336 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-da3ed619-f7c4-4b0c-92fb-2b85edf6b99b tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.671938 Aug 31 00:27:44.756670 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 425/833] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:44 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:45.114379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4d342ac6-ce1e-48cb-a3b2-5a405f2cc6d9 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:45.126860 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4d342ac6-ce1e-48cb-a3b2-5a405f2cc6d9 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1560 microversion: 2.1 time: 0.577704 Aug 31 00:27:45.127788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 409/834] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:44 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1560 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:45.782895 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:45.785067 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:45.798411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:45.799272 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:45.799922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:45.800894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:45.801554 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:45.802288 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:46.631167 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:46.649059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:46.651165 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:46.658960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c792769d-ba64-4da8-96a2-1a7eac13bbd8 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.880159 Aug 31 00:27:46.662648 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 426/835] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:45 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:47.705251 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:47.706053 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:47.720784 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:47.724310 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:47.726137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:47.729175 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:47.732006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:47.732870 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:48.128543 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:48.153333 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:48.166221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:48.173749 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a1d46253-36a4-49d8-8a02-10af451de5d7 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.474728 Aug 31 00:27:48.174849 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 410/836] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:47 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:49.235040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:49.236035 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:49.259742 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:49.261675 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:49.263106 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:49.266111 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:49.267383 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:49.268707 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:49.720925 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:49.732450 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:49.741283 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:49.745892 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ca52b006-5e27-4c78-b00d-648ae4d80a16 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.518933 Aug 31 00:27:49.750494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 427/837] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:49 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:50.805800 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:50.812052 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:50.850423 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:50.852010 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:50.853508 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:50.857122 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:50.859038 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:50.861144 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:50.900063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c8047f9b-8c34-404c-b122-47ba5f4ad594 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:50.901343 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c8047f9b-8c34-404c-b122-47ba5f4ad594 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:50.954256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c8047f9b-8c34-404c-b122-47ba5f4ad594 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:50.962029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c8047f9b-8c34-404c-b122-47ba5f4ad594 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:50.977435 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c8047f9b-8c34-404c-b122-47ba5f4ad594 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:50.979363 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c8047f9b-8c34-404c-b122-47ba5f4ad594 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:50.982377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c8047f9b-8c34-404c-b122-47ba5f4ad594 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:50.983132 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c8047f9b-8c34-404c-b122-47ba5f4ad594 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:51.104659 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c8047f9b-8c34-404c-b122-47ba5f4ad594 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/ips" status: 200 len: 148 microversion: 2.1 time: 0.201502 Aug 31 00:27:51.112102 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 428/838] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 31 00:27:50 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/ips => generated 148 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:27:51.131984 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:51.144822 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:51.147142 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:51.149009 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4e95a5f0-4dc1-4712-8c22-d173b64a50de tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.360728 Aug 31 00:27:51.150240 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 411/839] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:50 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:52.190861 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:52.191701 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:52.206983 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:52.207668 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:52.208125 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:52.209062 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:52.209541 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:52.209986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:52.570773 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:52.586501 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:52.589851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:52.592136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-df64b2d6-e523-435e-a312-d79aa650778d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.405545 Aug 31 00:27:52.593644 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 429/840] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:52 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:52.999621 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-dfad3df9-d9ca-4d3c-92f9-554d1789a102 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Action: 'create', calling method: .version_select at 0x7f1a3a7d2ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-64917146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwmpFQDOcY4k05UWFRqFh/AlBTrmUOkFK0X1dFzDotL0kjCzwMeeafXretmf55o3qhE2LmvT+1dRfrCMHulUnKgh71A0lA62D+f/D+vebxolAivWlWr3BS0pBegf8WoQg=="}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:53.039258 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-dfad3df9-d9ca-4d3c-92f9-554d1789a102 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Getting quotas for project d2b2473cfa244cf1aaaa6e4dac08a3d6. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:27:53.045852 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-dfad3df9-d9ca-4d3c-92f9-554d1789a102 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Getting quotas for user cacf8da1fc48427eacc993769c4f9f3a and project d2b2473cfa244cf1aaaa6e4dac08a3d6. Resources: {'key_pairs'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:27:53.085084 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-dfad3df9-d9ca-4d3c-92f9-554d1789a102 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.091686 Aug 31 00:27:53.086819 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 412/841] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 31 00:27:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:53.205769 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-88a742f2-2310-4c17-937a-38955f1df74f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4635a9e-eeeb-4cac-a04c-3a46858859af"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:53.210250 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-88a742f2-2310-4c17-937a-38955f1df74f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:53.237581 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88a742f2-2310-4c17-937a-38955f1df74f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:53.238408 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88a742f2-2310-4c17-937a-38955f1df74f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:53.239023 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88a742f2-2310-4c17-937a-38955f1df74f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:53.240401 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88a742f2-2310-4c17-937a-38955f1df74f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:53.241119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88a742f2-2310-4c17-937a-38955f1df74f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:53.241723 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88a742f2-2310-4c17-937a-38955f1df74f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:53.368352 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-150966053", "imageRef": "6caaae3f-c5a0-4a42-a479-7a4f5e5bc93f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-64917146", "networks": [{"uuid": "6737a6c0-97a2-478d-a9bd-2685b2635ce0"}]}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:53.512310 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] validate_networks() for [('6737a6c0-97a2-478d-a9bd-2685b2635ce0', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:27:54.190184 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:27:54.191221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:27:54.191409 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:27:54.191950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:27:54.192583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:27:54.206018 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:54.206510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:54.206941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:54.207688 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:54.208194 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:54.208664 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:54.233284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Getting quotas for project d2b2473cfa244cf1aaaa6e4dac08a3d6. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:27:54.239226 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Getting quotas for user cacf8da1fc48427eacc993769c4f9f3a and project d2b2473cfa244cf1aaaa6e4dac08a3d6. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:27:54.254596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:27:54.256994 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6caaae3f-c5a0-4a42-a479-7a4f5e5bc93f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:27:54.325442 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-55412296-0c38-44a7-9de3-8e3a3989236c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959864 Aug 31 00:27:54.328332 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 413/842] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:27:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:27:54.348419 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:54.349637 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:54.378541 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:54.379520 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:54.380337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:54.382141 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:54.383564 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:54.384699 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:54.744410 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:54.765774 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:54.769929 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:54.772653 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-08f7dbd6-b86f-4c00-a5f7-30bd0f1ac239 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.442573 Aug 31 00:27:54.774579 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 414/843] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:54 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:54.784335 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6e8f1861-7dab-4e91-9b55-c934a1be7f25 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:54.785913 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6e8f1861-7dab-4e91-9b55-c934a1be7f25 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:54.967095 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6e8f1861-7dab-4e91-9b55-c934a1be7f25 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:55.001307 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6e8f1861-7dab-4e91-9b55-c934a1be7f25 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1256 microversion: 2.1 time: 0.224545 Aug 31 00:27:55.005338 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 415/844] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:54 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1256 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:55.049518 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:55.530402 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-88a742f2-2310-4c17-937a-38955f1df74f tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "POST /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.328166 Aug 31 00:27:55.531959 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 430/845] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:27:53 2022] POST /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments => generated 194 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:55.816625 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:55.818617 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:55.828814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:55.829734 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:55.830444 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:55.831612 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:55.832373 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:55.833301 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:56.042552 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-67a6d3d8-d656-41a6-8394-11595bad6744 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:56.045081 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-67a6d3d8-d656-41a6-8394-11595bad6744 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:56.057611 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67a6d3d8-d656-41a6-8394-11595bad6744 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:56.058502 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67a6d3d8-d656-41a6-8394-11595bad6744 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:56.059439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67a6d3d8-d656-41a6-8394-11595bad6744 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:56.061093 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67a6d3d8-d656-41a6-8394-11595bad6744 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:56.061907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67a6d3d8-d656-41a6-8394-11595bad6744 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:56.062654 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-67a6d3d8-d656-41a6-8394-11595bad6744 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:56.078555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:56.105152 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:56.108411 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:56.110954 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-fb5e8b9e-123e-467c-85a3-d3a6869bcf5a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.299205 Aug 31 00:27:56.113901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 416/846] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:55 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:56.160300 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-67a6d3d8-d656-41a6-8394-11595bad6744 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:56.170392 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-67a6d3d8-d656-41a6-8394-11595bad6744 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1260 microversion: 2.1 time: 0.142054 Aug 31 00:27:56.171719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 431/847] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:56 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1260 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:57.138317 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:57.139823 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:57.147917 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.149505 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.150213 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.151257 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.151898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.153804 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.210905 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-241d42a5-f133-453c-ab31-c453837b98c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:57.213327 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-241d42a5-f133-453c-ab31-c453837b98c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:57.225923 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241d42a5-f133-453c-ab31-c453837b98c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.227680 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241d42a5-f133-453c-ab31-c453837b98c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.228372 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241d42a5-f133-453c-ab31-c453837b98c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.229826 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241d42a5-f133-453c-ab31-c453837b98c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.230530 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241d42a5-f133-453c-ab31-c453837b98c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.231177 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241d42a5-f133-453c-ab31-c453837b98c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.360098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-241d42a5-f133-453c-ab31-c453837b98c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:57.373944 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-241d42a5-f133-453c-ab31-c453837b98c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1260 microversion: 2.1 time: 0.169382 Aug 31 00:27:57.375005 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 432/848] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:57 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:57.409330 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:57.420185 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:57.421975 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:57.423242 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-47dbae3c-a177-4de5-9341-172dd3078fb6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.289031 Aug 31 00:27:57.423829 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 417/849] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:57 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:58.409893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-fd3ea668-ef1f-4044-9148-c4bd39b3be13 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:58.410898 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-fd3ea668-ef1f-4044-9148-c4bd39b3be13 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:58.422998 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fd3ea668-ef1f-4044-9148-c4bd39b3be13 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:58.423837 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fd3ea668-ef1f-4044-9148-c4bd39b3be13 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:58.424630 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fd3ea668-ef1f-4044-9148-c4bd39b3be13 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:58.425843 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fd3ea668-ef1f-4044-9148-c4bd39b3be13 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:58.426624 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fd3ea668-ef1f-4044-9148-c4bd39b3be13 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:58.427367 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fd3ea668-ef1f-4044-9148-c4bd39b3be13 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:58.453355 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:58.454832 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:58.466955 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:58.467738 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:58.468352 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:58.469228 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:58.469926 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:58.470588 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:58.533035 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-fd3ea668-ef1f-4044-9148-c4bd39b3be13 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:58.548688 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-fd3ea668-ef1f-4044-9148-c4bd39b3be13 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1260 microversion: 2.1 time: 0.146592 Aug 31 00:27:58.549807 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 433/850] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:58 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:58.667859 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:58.678276 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:58.679737 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:58.680966 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-31a0ab50-3f6a-4457-97fc-4efee000f0cf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.236749 Aug 31 00:27:58.681581 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 418/851] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:58 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:59.582304 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-37e381a4-5b12-473f-bf3a-2b688f1f4983 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:59.582912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-37e381a4-5b12-473f-bf3a-2b688f1f4983 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:59.590453 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-37e381a4-5b12-473f-bf3a-2b688f1f4983 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:59.591261 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-37e381a4-5b12-473f-bf3a-2b688f1f4983 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:59.591712 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-37e381a4-5b12-473f-bf3a-2b688f1f4983 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:59.592498 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-37e381a4-5b12-473f-bf3a-2b688f1f4983 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:59.592956 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-37e381a4-5b12-473f-bf3a-2b688f1f4983 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:59.593382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-37e381a4-5b12-473f-bf3a-2b688f1f4983 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:59.663263 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-37e381a4-5b12-473f-bf3a-2b688f1f4983 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:59.672547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-37e381a4-5b12-473f-bf3a-2b688f1f4983 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1260 microversion: 2.1 time: 0.094213 Aug 31 00:27:59.673147 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 434/852] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:59 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1260 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:59.705442 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:59.706127 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:59.713060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:59.713548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:59.713982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:59.714700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:59.715833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:59.716666 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:59.869950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:59.879899 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:59.881508 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:59.882786 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-090fe2f4-736f-46ff-a6a5-4a640f20ae28 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.181336 Aug 31 00:27:59.883359 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 419/853] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:59 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:00.694640 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-230dc4ac-428a-4cbd-81a8-6a7814f27b20 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:00.695493 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-230dc4ac-428a-4cbd-81a8-6a7814f27b20 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:00.703127 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-230dc4ac-428a-4cbd-81a8-6a7814f27b20 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:00.703643 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-230dc4ac-428a-4cbd-81a8-6a7814f27b20 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:00.704053 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-230dc4ac-428a-4cbd-81a8-6a7814f27b20 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:00.704817 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-230dc4ac-428a-4cbd-81a8-6a7814f27b20 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:00.705271 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-230dc4ac-428a-4cbd-81a8-6a7814f27b20 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:00.705709 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-230dc4ac-428a-4cbd-81a8-6a7814f27b20 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:00.789067 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-230dc4ac-428a-4cbd-81a8-6a7814f27b20 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:00.799143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-230dc4ac-428a-4cbd-81a8-6a7814f27b20 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1252 microversion: 2.1 time: 0.108717 Aug 31 00:28:00.799876 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 435/854] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:00 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1252 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:00.907927 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:00.908655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:00.915972 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:00.916493 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:00.917005 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:00.917668 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:00.918766 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:00.919204 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:01.113212 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:01.123349 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:01.124847 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:01.126044 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-9d020114-8df1-4924-8cd7-6ee723b87ef3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.223704 Aug 31 00:28:01.126623 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 420/855] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:00 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:01.831551 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-322ef4ff-bd27-4d08-874a-02b0906f11e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:01.832845 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-322ef4ff-bd27-4d08-874a-02b0906f11e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:01.846046 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-322ef4ff-bd27-4d08-874a-02b0906f11e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:01.846779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-322ef4ff-bd27-4d08-874a-02b0906f11e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:01.847647 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-322ef4ff-bd27-4d08-874a-02b0906f11e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:01.849016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-322ef4ff-bd27-4d08-874a-02b0906f11e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:01.849893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-322ef4ff-bd27-4d08-874a-02b0906f11e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:01.850955 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-322ef4ff-bd27-4d08-874a-02b0906f11e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:01.945608 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-322ef4ff-bd27-4d08-874a-02b0906f11e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:01.955880 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-322ef4ff-bd27-4d08-874a-02b0906f11e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1308 microversion: 2.1 time: 0.135774 Aug 31 00:28:01.956640 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 436/856] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:01 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:02.160281 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:02.162736 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:02.178321 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:02.179585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:02.180849 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:02.183054 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:02.185861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:02.186878 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:02.199376 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:02.651482 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:02.661990 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:02.663635 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:02.664866 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3e5474ff-a8ba-408a-81a8-fbb61d3dadc3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.517992 Aug 31 00:28:02.677007 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 421/857] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:02 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:03.004893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d82ca217-e7fe-42d7-ac61-a039c75ee3dc tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:03.006368 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d82ca217-e7fe-42d7-ac61-a039c75ee3dc tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:03.020573 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d82ca217-e7fe-42d7-ac61-a039c75ee3dc tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:03.022041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d82ca217-e7fe-42d7-ac61-a039c75ee3dc tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:03.024265 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d82ca217-e7fe-42d7-ac61-a039c75ee3dc tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:03.025843 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d82ca217-e7fe-42d7-ac61-a039c75ee3dc tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:03.026910 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d82ca217-e7fe-42d7-ac61-a039c75ee3dc tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:03.027995 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d82ca217-e7fe-42d7-ac61-a039c75ee3dc tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:03.475469 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d82ca217-e7fe-42d7-ac61-a039c75ee3dc tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:03.519984 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d82ca217-e7fe-42d7-ac61-a039c75ee3dc tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1314 microversion: 2.1 time: 0.540476 Aug 31 00:28:03.537109 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 437/858] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:02 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:03.718203 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:03.724061 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:03.770297 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:03.771789 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:03.773307 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:03.779456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:03.789689 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:03.794797 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:03.910508 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-7e2dc6f5-b7a0-45a4-83d2-a28670efae12 req-cdbf0227-c179-4988-bdfd-5244d3c7e649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698d47ed-0a7a-4601-87a9-beb0597d3045", "name": "network-vif-plugged", "status": "completed", "tag": "9e1236d0-86cd-45da-a9dc-878f6a1707a4"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:04.030063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-7e2dc6f5-b7a0-45a4-83d2-a28670efae12 req-cdbf0227-c179-4988-bdfd-5244d3c7e649 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:04.032969 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-7e2dc6f5-b7a0-45a4-83d2-a28670efae12 req-cdbf0227-c179-4988-bdfd-5244d3c7e649 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:04.034025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-7e2dc6f5-b7a0-45a4-83d2-a28670efae12 req-cdbf0227-c179-4988-bdfd-5244d3c7e649 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:04.101517 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-7e2dc6f5-b7a0-45a4-83d2-a28670efae12 req-cdbf0227-c179-4988-bdfd-5244d3c7e649 service nova] Creating event network-vif-plugged:9e1236d0-86cd-45da-a9dc-878f6a1707a4 for instance 698d47ed-0a7a-4601-87a9-beb0597d3045 on hv-cinder-85221 Aug 31 00:28:04.150538 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-7e2dc6f5-b7a0-45a4-83d2-a28670efae12 req-cdbf0227-c179-4988-bdfd-5244d3c7e649 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259469 Aug 31 00:28:04.156668 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 438/859] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:04.222448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:04.533292 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:04.572592 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4e64db8e-2d72-41ca-8baa-d736dc0d43aa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:04.573924 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:04.580088 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4e64db8e-2d72-41ca-8baa-d736dc0d43aa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:04.582243 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:04.586982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8edd30ec-83bd-435a-bff3-b334d8ed887f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.882505 Aug 31 00:28:04.615241 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 422/860] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:03 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:28:04.648793 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e64db8e-2d72-41ca-8baa-d736dc0d43aa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:04.660743 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e64db8e-2d72-41ca-8baa-d736dc0d43aa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:04.661682 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e64db8e-2d72-41ca-8baa-d736dc0d43aa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:04.670607 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e64db8e-2d72-41ca-8baa-d736dc0d43aa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:04.675134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e64db8e-2d72-41ca-8baa-d736dc0d43aa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:04.678697 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4e64db8e-2d72-41ca-8baa-d736dc0d43aa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:05.644559 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:05.646737 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:05.658751 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=12 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:05.674604 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:05.679755 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:05.682239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:05.684864 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:05.686104 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:05.687194 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:05.723323 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4e64db8e-2d72-41ca-8baa-d736dc0d43aa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:05.755186 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4e64db8e-2d72-41ca-8baa-d736dc0d43aa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 1.189751 Aug 31 00:28:05.757561 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 439/861] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:04 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:06.085652 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:06.109012 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:06.112728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:06.115397 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3e101a51-4470-4a8b-9dc7-a106826c519f tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.478364 Aug 31 00:28:06.122299 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 423/862] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:05 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:28:06.797414 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-04b5f3cb-c746-4b09-b4b7-a16dbc2d7bf4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:06.801063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-04b5f3cb-c746-4b09-b4b7-a16dbc2d7bf4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:06.834860 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04b5f3cb-c746-4b09-b4b7-a16dbc2d7bf4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:06.837489 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04b5f3cb-c746-4b09-b4b7-a16dbc2d7bf4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:06.839249 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04b5f3cb-c746-4b09-b4b7-a16dbc2d7bf4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:06.842419 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04b5f3cb-c746-4b09-b4b7-a16dbc2d7bf4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:06.843684 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04b5f3cb-c746-4b09-b4b7-a16dbc2d7bf4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:06.844732 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-04b5f3cb-c746-4b09-b4b7-a16dbc2d7bf4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.154732 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-3822f477-1a13-4912-8723-266adf3dd566 req-9cb2220b-eca4-4b78-996a-084a38203632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e", "tag": "05830bf8-556a-469a-9d00-f97cadfd56ba"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:07.217956 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:07.228768 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-3822f477-1a13-4912-8723-266adf3dd566 req-9cb2220b-eca4-4b78-996a-084a38203632 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.229964 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-3822f477-1a13-4912-8723-266adf3dd566 req-9cb2220b-eca4-4b78-996a-084a38203632 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.230773 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-3822f477-1a13-4912-8723-266adf3dd566 req-9cb2220b-eca4-4b78-996a-084a38203632 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.285429 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-3822f477-1a13-4912-8723-266adf3dd566 req-9cb2220b-eca4-4b78-996a-084a38203632 service nova] Creating event network-changed:05830bf8-556a-469a-9d00-f97cadfd56ba for instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e on hv-cinder-85221 Aug 31 00:28:07.302633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-3822f477-1a13-4912-8723-266adf3dd566 req-9cb2220b-eca4-4b78-996a-084a38203632 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165271 Aug 31 00:28:07.308803 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 424/863] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:07.329396 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:07.330761 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:07.357481 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.361980 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.362930 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.364448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.373626 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.374469 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.421191 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-04b5f3cb-c746-4b09-b4b7-a16dbc2d7bf4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:07.434863 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-04b5f3cb-c746-4b09-b4b7-a16dbc2d7bf4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.647414 Aug 31 00:28:07.436237 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 440/864] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:06 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:07.744700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:07.765163 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:07.770362 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:07.773764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c3d6c14b-d233-4718-9151-670987c34b34 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.462426 Aug 31 00:28:07.775584 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 425/865] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:07 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:08.463322 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8ba28c57-648d-4f5f-bf0f-04e44a98a790 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:08.464433 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8ba28c57-648d-4f5f-bf0f-04e44a98a790 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:08.477123 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8ba28c57-648d-4f5f-bf0f-04e44a98a790 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:08.478394 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8ba28c57-648d-4f5f-bf0f-04e44a98a790 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:08.479454 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8ba28c57-648d-4f5f-bf0f-04e44a98a790 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:08.481472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8ba28c57-648d-4f5f-bf0f-04e44a98a790 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:08.482300 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8ba28c57-648d-4f5f-bf0f-04e44a98a790 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:08.483069 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8ba28c57-648d-4f5f-bf0f-04e44a98a790 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:08.708805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8ba28c57-648d-4f5f-bf0f-04e44a98a790 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:08.726353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8ba28c57-648d-4f5f-bf0f-04e44a98a790 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.269729 Aug 31 00:28:08.728708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 441/866] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:08 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:08.816072 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:08.816980 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:08.823948 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:08.825246 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:08.825697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:08.826443 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:08.826907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:08.827337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:09.350953 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:09.367344 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:09.376965 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:09.379252 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cfdc9a7f-0602-4aeb-9730-65830dac9a52 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.567416 Aug 31 00:28:09.400215 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 426/867] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:08 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:28:09.766763 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7bdc869e-238e-4286-98cf-3931f7567d42 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:09.769180 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7bdc869e-238e-4286-98cf-3931f7567d42 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:09.775917 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=46 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:09.783786 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7bdc869e-238e-4286-98cf-3931f7567d42 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:09.785558 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7bdc869e-238e-4286-98cf-3931f7567d42 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:09.786788 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7bdc869e-238e-4286-98cf-3931f7567d42 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:09.787956 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7bdc869e-238e-4286-98cf-3931f7567d42 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:09.788817 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7bdc869e-238e-4286-98cf-3931f7567d42 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:09.789584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7bdc869e-238e-4286-98cf-3931f7567d42 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:09.977581 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7bdc869e-238e-4286-98cf-3931f7567d42 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:09.987802 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7bdc869e-238e-4286-98cf-3931f7567d42 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.228291 Aug 31 00:28:10.003031 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 442/868] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:09 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:10.424373 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:10.425487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:10.436796 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.438126 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.438736 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.440357 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.441417 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.441861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.787164 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:10.802062 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:10.804585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:10.808422 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-abdb81d7-4fb6-4ee3-9547-26e04abd535c tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.390595 Aug 31 00:28:10.810312 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 427/869] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:10 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:11.015708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-261ad65a-a5bc-4bb5-b136-6221877fd44e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:11.027004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-261ad65a-a5bc-4bb5-b136-6221877fd44e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:11.027004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-261ad65a-a5bc-4bb5-b136-6221877fd44e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.027004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-261ad65a-a5bc-4bb5-b136-6221877fd44e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.031600 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-261ad65a-a5bc-4bb5-b136-6221877fd44e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.035272 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-261ad65a-a5bc-4bb5-b136-6221877fd44e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.035272 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-261ad65a-a5bc-4bb5-b136-6221877fd44e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.035272 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-261ad65a-a5bc-4bb5-b136-6221877fd44e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.372219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-261ad65a-a5bc-4bb5-b136-6221877fd44e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:11.392244 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-261ad65a-a5bc-4bb5-b136-6221877fd44e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.379455 Aug 31 00:28:11.394547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 443/870] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:11 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:11.849008 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:11.851390 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:11.860551 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.861448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.863262 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.864118 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.864976 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:12.114825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:12.130931 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:12.134318 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:12.139075 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2cd85b53-41f7-4f94-af86-11613833daaf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.295642 Aug 31 00:28:12.141075 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 428/871] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:11 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:28:12.438272 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-6ac2ab2c-6b14-4d70-84f3-7e3be3c44bca tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:12.447315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-6ac2ab2c-6b14-4d70-84f3-7e3be3c44bca tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:12.461495 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6ac2ab2c-6b14-4d70-84f3-7e3be3c44bca tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:12.463062 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6ac2ab2c-6b14-4d70-84f3-7e3be3c44bca tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:12.464212 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6ac2ab2c-6b14-4d70-84f3-7e3be3c44bca tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:12.467320 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6ac2ab2c-6b14-4d70-84f3-7e3be3c44bca tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:12.469601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6ac2ab2c-6b14-4d70-84f3-7e3be3c44bca tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:12.474630 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-6ac2ab2c-6b14-4d70-84f3-7e3be3c44bca tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:12.810261 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-6ac2ab2c-6b14-4d70-84f3-7e3be3c44bca tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:12.825367 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-6ac2ab2c-6b14-4d70-84f3-7e3be3c44bca tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.397242 Aug 31 00:28:12.826144 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 444/872] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:12 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:13.186902 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:13.188019 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:13.201847 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.203402 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.204301 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.205661 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.206547 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.207608 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.606463 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:13.618595 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:13.621714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:13.623618 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-099c8cd6-670a-404c-b51b-5489870098b2 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.446558 Aug 31 00:28:13.624467 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 429/873] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:13 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:13.861546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8419822b-0bb9-4de9-aa83-1044d260cd71 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:13.862407 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8419822b-0bb9-4de9-aa83-1044d260cd71 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:13.869465 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8419822b-0bb9-4de9-aa83-1044d260cd71 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.869945 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8419822b-0bb9-4de9-aa83-1044d260cd71 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.870387 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8419822b-0bb9-4de9-aa83-1044d260cd71 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.871123 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8419822b-0bb9-4de9-aa83-1044d260cd71 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.871621 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8419822b-0bb9-4de9-aa83-1044d260cd71 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.872053 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8419822b-0bb9-4de9-aa83-1044d260cd71 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:14.109803 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8419822b-0bb9-4de9-aa83-1044d260cd71 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:14.122402 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8419822b-0bb9-4de9-aa83-1044d260cd71 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.263763 Aug 31 00:28:14.123890 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 445/874] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:13 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:14.657253 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:14.658020 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:14.665571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:14.666073 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:14.666511 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:14.667241 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:14.667713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:14.668466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:14.912952 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:14.928950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:14.930505 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:14.931743 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a0d78dfd-05d6-4481-bf18-2b6b607d1a2e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1731 microversion: 2.20 time: 0.278973 Aug 31 00:28:14.935441 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 430/875] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:14 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1731 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:15.161971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-095fa999-1614-4696-a0d4-5950c5a82d0c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:15.163323 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-095fa999-1614-4696-a0d4-5950c5a82d0c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:15.171740 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-095fa999-1614-4696-a0d4-5950c5a82d0c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:15.172388 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-095fa999-1614-4696-a0d4-5950c5a82d0c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:15.172996 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-095fa999-1614-4696-a0d4-5950c5a82d0c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:15.173961 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-095fa999-1614-4696-a0d4-5950c5a82d0c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:15.174555 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-095fa999-1614-4696-a0d4-5950c5a82d0c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:15.175059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-095fa999-1614-4696-a0d4-5950c5a82d0c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:15.376525 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-095fa999-1614-4696-a0d4-5950c5a82d0c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:15.390706 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-095fa999-1614-4696-a0d4-5950c5a82d0c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.233423 Aug 31 00:28:15.391580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 446/876] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:15 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:15.983995 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:15.985304 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:15.998750 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.000248 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.001043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.002759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.003901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.005401 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.279707 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:16.290370 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:16.293228 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:16.294622 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b8fcecba-625f-4553-83a3-010f259acbcf tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1718 microversion: 2.20 time: 0.317179 Aug 31 00:28:16.295251 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 431/877] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:15 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1718 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:16.394531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f51d2afa-f352-4543-89bc-f74bad6a12b3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:16.395809 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f51d2afa-f352-4543-89bc-f74bad6a12b3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:16.404897 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f51d2afa-f352-4543-89bc-f74bad6a12b3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.405753 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f51d2afa-f352-4543-89bc-f74bad6a12b3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.406399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f51d2afa-f352-4543-89bc-f74bad6a12b3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.406955 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f51d2afa-f352-4543-89bc-f74bad6a12b3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.407477 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f51d2afa-f352-4543-89bc-f74bad6a12b3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.407868 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f51d2afa-f352-4543-89bc-f74bad6a12b3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.411248 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:16.429739 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b347bd33-4ef4-4d4c-8081-c8e89dd5f7d7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:16.430786 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b347bd33-4ef4-4d4c-8081-c8e89dd5f7d7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:16.443849 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b347bd33-4ef4-4d4c-8081-c8e89dd5f7d7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.447872 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b347bd33-4ef4-4d4c-8081-c8e89dd5f7d7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.449205 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b347bd33-4ef4-4d4c-8081-c8e89dd5f7d7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.451219 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b347bd33-4ef4-4d4c-8081-c8e89dd5f7d7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.452646 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b347bd33-4ef4-4d4c-8081-c8e89dd5f7d7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.453720 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b347bd33-4ef4-4d4c-8081-c8e89dd5f7d7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.539155 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-f51d2afa-f352-4543-89bc-f74bad6a12b3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lazy-loading 'services' on Instance uuid 13034131-50e5-4af9-866a-d1886e4f1d1f {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:28:16.675487 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f51d2afa-f352-4543-89bc-f74bad6a12b3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments/b4635a9e-eeeb-4cac-a04c-3a46858859af" status: 202 len: 0 microversion: 2.1 time: 0.289618 Aug 31 00:28:16.677761 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 447/878] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:28:16 2022] DELETE /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments/b4635a9e-eeeb-4cac-a04c-3a46858859af => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:28:16.695110 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b8bba57f-9df3-44b1-96bc-6837ed3f9ba8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:16.701265 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b8bba57f-9df3-44b1-96bc-6837ed3f9ba8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:16.711202 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b347bd33-4ef4-4d4c-8081-c8e89dd5f7d7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:16.713852 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8bba57f-9df3-44b1-96bc-6837ed3f9ba8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.716215 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8bba57f-9df3-44b1-96bc-6837ed3f9ba8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.717349 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8bba57f-9df3-44b1-96bc-6837ed3f9ba8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.718739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8bba57f-9df3-44b1-96bc-6837ed3f9ba8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.719218 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8bba57f-9df3-44b1-96bc-6837ed3f9ba8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.719967 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8bba57f-9df3-44b1-96bc-6837ed3f9ba8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.731887 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b347bd33-4ef4-4d4c-8081-c8e89dd5f7d7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.309696 Aug 31 00:28:16.733564 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 432/879] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:16 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:16.811779 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b8bba57f-9df3-44b1-96bc-6837ed3f9ba8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124861 Aug 31 00:28:16.813368 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 448/880] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:28:16 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:17.769767 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-35023292-c8c6-4780-bbab-02a59708cc62 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:17.770723 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-35023292-c8c6-4780-bbab-02a59708cc62 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:17.778631 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35023292-c8c6-4780-bbab-02a59708cc62 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:17.779375 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35023292-c8c6-4780-bbab-02a59708cc62 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:17.779742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35023292-c8c6-4780-bbab-02a59708cc62 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:17.780547 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35023292-c8c6-4780-bbab-02a59708cc62 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:17.781079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35023292-c8c6-4780-bbab-02a59708cc62 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:17.781578 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-35023292-c8c6-4780-bbab-02a59708cc62 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:17.833980 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8fa60a8a-1842-4e61-9b27-bcba5d486f1a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:17.838250 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8fa60a8a-1842-4e61-9b27-bcba5d486f1a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:17.850334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8fa60a8a-1842-4e61-9b27-bcba5d486f1a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:17.851214 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8fa60a8a-1842-4e61-9b27-bcba5d486f1a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:17.851989 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8fa60a8a-1842-4e61-9b27-bcba5d486f1a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:17.853280 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8fa60a8a-1842-4e61-9b27-bcba5d486f1a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:17.854111 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8fa60a8a-1842-4e61-9b27-bcba5d486f1a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:17.854890 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8fa60a8a-1842-4e61-9b27-bcba5d486f1a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:17.892319 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8fa60a8a-1842-4e61-9b27-bcba5d486f1a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067138 Aug 31 00:28:17.893255 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 449/881] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:28:17 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:17.988206 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-35023292-c8c6-4780-bbab-02a59708cc62 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:17.997346 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-35023292-c8c6-4780-bbab-02a59708cc62 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.231336 Aug 31 00:28:17.997926 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 433/882] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:17 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:18.906140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0928f9fc-d4d1-4ec6-a45c-f6b50fcd097a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:18.910060 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0928f9fc-d4d1-4ec6-a45c-f6b50fcd097a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:18.918133 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0928f9fc-d4d1-4ec6-a45c-f6b50fcd097a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:18.918954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0928f9fc-d4d1-4ec6-a45c-f6b50fcd097a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:18.919675 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0928f9fc-d4d1-4ec6-a45c-f6b50fcd097a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:18.920914 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0928f9fc-d4d1-4ec6-a45c-f6b50fcd097a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:18.921670 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0928f9fc-d4d1-4ec6-a45c-f6b50fcd097a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:18.922380 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0928f9fc-d4d1-4ec6-a45c-f6b50fcd097a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:18.975841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0928f9fc-d4d1-4ec6-a45c-f6b50fcd097a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073352 Aug 31 00:28:18.976739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 450/883] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:28:18 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:28:19.034641 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-bcb984eb-23b7-4c72-9b01-767b5551de05 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:19.035937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-bcb984eb-23b7-4c72-9b01-767b5551de05 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:19.047660 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcb984eb-23b7-4c72-9b01-767b5551de05 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:19.048537 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcb984eb-23b7-4c72-9b01-767b5551de05 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:19.049321 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcb984eb-23b7-4c72-9b01-767b5551de05 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:19.050529 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcb984eb-23b7-4c72-9b01-767b5551de05 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:19.051359 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcb984eb-23b7-4c72-9b01-767b5551de05 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:19.052115 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-bcb984eb-23b7-4c72-9b01-767b5551de05 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:19.239556 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-bcb984eb-23b7-4c72-9b01-767b5551de05 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:19.248167 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-bcb984eb-23b7-4c72-9b01-767b5551de05 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.220465 Aug 31 00:28:19.248809 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 434/884] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:19 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:19.997246 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c29ec259-df50-4286-81c1-6b80852f7b78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:20.001122 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c29ec259-df50-4286-81c1-6b80852f7b78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:20.012720 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c29ec259-df50-4286-81c1-6b80852f7b78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.013583 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c29ec259-df50-4286-81c1-6b80852f7b78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.014354 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c29ec259-df50-4286-81c1-6b80852f7b78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.015642 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c29ec259-df50-4286-81c1-6b80852f7b78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.016483 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c29ec259-df50-4286-81c1-6b80852f7b78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.017257 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c29ec259-df50-4286-81c1-6b80852f7b78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.053659 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c29ec259-df50-4286-81c1-6b80852f7b78 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064829 Aug 31 00:28:20.054336 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 451/885] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:28:19 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:28:20.149156 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-afa0eef1-0866-408e-bfed-371e3daa18a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:20.150011 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-afa0eef1-0866-408e-bfed-371e3daa18a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:20.157787 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-afa0eef1-0866-408e-bfed-371e3daa18a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.158337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-afa0eef1-0866-408e-bfed-371e3daa18a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.158930 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-afa0eef1-0866-408e-bfed-371e3daa18a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.160419 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-afa0eef1-0866-408e-bfed-371e3daa18a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.161538 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-afa0eef1-0866-408e-bfed-371e3daa18a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.161538 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-afa0eef1-0866-408e-bfed-371e3daa18a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.196003 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-afa0eef1-0866-408e-bfed-371e3daa18a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:28:20.275631 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9c065d7e-f2fd-4f34-83e5-a01cb191a8cd tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:20.276355 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9c065d7e-f2fd-4f34-83e5-a01cb191a8cd tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:20.284048 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9c065d7e-f2fd-4f34-83e5-a01cb191a8cd tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.284580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9c065d7e-f2fd-4f34-83e5-a01cb191a8cd tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.285017 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9c065d7e-f2fd-4f34-83e5-a01cb191a8cd tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.285754 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9c065d7e-f2fd-4f34-83e5-a01cb191a8cd tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.286441 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9c065d7e-f2fd-4f34-83e5-a01cb191a8cd tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.286906 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9c065d7e-f2fd-4f34-83e5-a01cb191a8cd tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.313272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-afa0eef1-0866-408e-bfed-371e3daa18a6 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 204 len: 0 microversion: 2.1 time: 0.168252 Aug 31 00:28:20.314484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 435/886] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:28:20 2022] DELETE /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:28:20.327127 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-31472c39-6a97-43f3-9171-db24da80831c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:20.327836 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-31472c39-6a97-43f3-9171-db24da80831c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:20.334696 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31472c39-6a97-43f3-9171-db24da80831c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.335238 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31472c39-6a97-43f3-9171-db24da80831c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.335674 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31472c39-6a97-43f3-9171-db24da80831c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.336415 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31472c39-6a97-43f3-9171-db24da80831c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.336874 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31472c39-6a97-43f3-9171-db24da80831c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.337291 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31472c39-6a97-43f3-9171-db24da80831c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.523695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9c065d7e-f2fd-4f34-83e5-a01cb191a8cd tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:20.534066 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9c065d7e-f2fd-4f34-83e5-a01cb191a8cd tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.266164 Aug 31 00:28:20.534689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 452/887] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:20 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:20.555633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-31472c39-6a97-43f3-9171-db24da80831c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:20.560570 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:20.573492 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-31472c39-6a97-43f3-9171-db24da80831c tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1678 microversion: 2.1 time: 0.250847 Aug 31 00:28:20.575969 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 436/888] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:20 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:21.558590 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-874b79e2-4ad0-4823-bb7d-fff18e961a5c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:21.559492 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-874b79e2-4ad0-4823-bb7d-fff18e961a5c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:21.566410 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-874b79e2-4ad0-4823-bb7d-fff18e961a5c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:21.566908 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-874b79e2-4ad0-4823-bb7d-fff18e961a5c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:21.567345 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-874b79e2-4ad0-4823-bb7d-fff18e961a5c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:21.568083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-874b79e2-4ad0-4823-bb7d-fff18e961a5c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:21.568581 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-874b79e2-4ad0-4823-bb7d-fff18e961a5c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:21.569009 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-874b79e2-4ad0-4823-bb7d-fff18e961a5c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:21.606061 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-72ee2b71-57b4-4338-a4cc-a306fc434da7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:21.607584 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-72ee2b71-57b4-4338-a4cc-a306fc434da7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:21.623239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72ee2b71-57b4-4338-a4cc-a306fc434da7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:21.623957 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72ee2b71-57b4-4338-a4cc-a306fc434da7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:21.624612 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72ee2b71-57b4-4338-a4cc-a306fc434da7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:21.625698 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72ee2b71-57b4-4338-a4cc-a306fc434da7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:21.626454 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72ee2b71-57b4-4338-a4cc-a306fc434da7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:21.627400 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-72ee2b71-57b4-4338-a4cc-a306fc434da7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:21.831153 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-874b79e2-4ad0-4823-bb7d-fff18e961a5c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:21.847303 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-874b79e2-4ad0-4823-bb7d-fff18e961a5c tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.292301 Aug 31 00:28:21.848223 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 453/889] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:21 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:21.863506 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-72ee2b71-57b4-4338-a4cc-a306fc434da7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:21.873441 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-72ee2b71-57b4-4338-a4cc-a306fc434da7 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1678 microversion: 2.1 time: 0.273642 Aug 31 00:28:21.873948 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 437/890] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:21 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1678 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:22.879720 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7b96fa3a-437f-48ba-9602-14b53c1398c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:22.880858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7b96fa3a-437f-48ba-9602-14b53c1398c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:22.893047 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b96fa3a-437f-48ba-9602-14b53c1398c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:22.893971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b96fa3a-437f-48ba-9602-14b53c1398c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:22.894751 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b96fa3a-437f-48ba-9602-14b53c1398c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:22.896099 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2ca10569-0360-4641-a340-aff9efe2862b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:22.896677 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b96fa3a-437f-48ba-9602-14b53c1398c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:22.896831 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2ca10569-0360-4641-a340-aff9efe2862b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:22.897420 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b96fa3a-437f-48ba-9602-14b53c1398c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:22.898798 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7b96fa3a-437f-48ba-9602-14b53c1398c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:22.904753 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2ca10569-0360-4641-a340-aff9efe2862b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:22.905257 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2ca10569-0360-4641-a340-aff9efe2862b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:22.905694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2ca10569-0360-4641-a340-aff9efe2862b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:22.906420 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2ca10569-0360-4641-a340-aff9efe2862b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:22.906875 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2ca10569-0360-4641-a340-aff9efe2862b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:22.907302 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2ca10569-0360-4641-a340-aff9efe2862b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:23.220025 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2ca10569-0360-4641-a340-aff9efe2862b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:23.229138 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2ca10569-0360-4641-a340-aff9efe2862b tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1678 microversion: 2.1 time: 0.336864 Aug 31 00:28:23.229726 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 438/891] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:22 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1678 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:23.230904 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7b96fa3a-437f-48ba-9602-14b53c1398c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:23.244860 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7b96fa3a-437f-48ba-9602-14b53c1398c0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.372614 Aug 31 00:28:23.245927 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 454/892] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:22 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:24.251994 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-49cf03e6-28bc-4dc3-b0bd-55b4c6cac076 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:24.252723 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-49cf03e6-28bc-4dc3-b0bd-55b4c6cac076 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:24.259391 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-49cf03e6-28bc-4dc3-b0bd-55b4c6cac076 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:24.259887 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-49cf03e6-28bc-4dc3-b0bd-55b4c6cac076 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:24.260355 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-49cf03e6-28bc-4dc3-b0bd-55b4c6cac076 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:24.261082 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-49cf03e6-28bc-4dc3-b0bd-55b4c6cac076 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:24.262265 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-49cf03e6-28bc-4dc3-b0bd-55b4c6cac076 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:24.262718 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-49cf03e6-28bc-4dc3-b0bd-55b4c6cac076 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:24.269145 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ee667682-76ad-4a5c-be52-782909fbe0fa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:24.269970 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ee667682-76ad-4a5c-be52-782909fbe0fa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:24.278794 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee667682-76ad-4a5c-be52-782909fbe0fa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:24.279298 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee667682-76ad-4a5c-be52-782909fbe0fa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:24.279742 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee667682-76ad-4a5c-be52-782909fbe0fa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:24.280531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee667682-76ad-4a5c-be52-782909fbe0fa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:24.280988 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee667682-76ad-4a5c-be52-782909fbe0fa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:24.281411 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ee667682-76ad-4a5c-be52-782909fbe0fa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:24.526546 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-49cf03e6-28bc-4dc3-b0bd-55b4c6cac076 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:24.535033 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-49cf03e6-28bc-4dc3-b0bd-55b4c6cac076 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1678 microversion: 2.1 time: 0.287247 Aug 31 00:28:24.535809 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 439/893] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:24 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1678 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:24.541426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ee667682-76ad-4a5c-be52-782909fbe0fa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:24.550371 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ee667682-76ad-4a5c-be52-782909fbe0fa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.286353 Aug 31 00:28:24.550969 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 455/894] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:24 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:25.558231 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5054d5ff-2e02-4dbf-a8d1-f4af5368acec tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:25.559606 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5054d5ff-2e02-4dbf-a8d1-f4af5368acec tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:25.566551 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5054d5ff-2e02-4dbf-a8d1-f4af5368acec tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:25.567059 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5054d5ff-2e02-4dbf-a8d1-f4af5368acec tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:25.567505 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5054d5ff-2e02-4dbf-a8d1-f4af5368acec tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:25.568399 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5054d5ff-2e02-4dbf-a8d1-f4af5368acec tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:25.568908 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5054d5ff-2e02-4dbf-a8d1-f4af5368acec tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:25.569338 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5054d5ff-2e02-4dbf-a8d1-f4af5368acec tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:25.572655 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-fba4a056-bdda-4a5d-8df0-c2b93ed89dae tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:25.573453 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-fba4a056-bdda-4a5d-8df0-c2b93ed89dae tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:25.581138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fba4a056-bdda-4a5d-8df0-c2b93ed89dae tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:25.581708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fba4a056-bdda-4a5d-8df0-c2b93ed89dae tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:25.582204 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fba4a056-bdda-4a5d-8df0-c2b93ed89dae tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:25.583048 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fba4a056-bdda-4a5d-8df0-c2b93ed89dae tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:25.583557 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fba4a056-bdda-4a5d-8df0-c2b93ed89dae tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:25.584100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fba4a056-bdda-4a5d-8df0-c2b93ed89dae tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:25.882414 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-5054d5ff-2e02-4dbf-a8d1-f4af5368acec tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:25.899518 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5054d5ff-2e02-4dbf-a8d1-f4af5368acec tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1678 microversion: 2.1 time: 0.345015 Aug 31 00:28:25.900545 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 440/895] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:25 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1678 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:25.908843 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-fba4a056-bdda-4a5d-8df0-c2b93ed89dae tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:25.925456 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-fba4a056-bdda-4a5d-8df0-c2b93ed89dae tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.356837 Aug 31 00:28:25.926634 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 456/896] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:25 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:26.459221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-8197d283-728e-4e61-9e81-482a3e0aa830 req-39c0fb31-12cb-4344-89c9-e9155ecd4fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e", "name": "network-vif-plugged", "status": "completed", "tag": "05830bf8-556a-469a-9d00-f97cadfd56ba"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:26.479141 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-8197d283-728e-4e61-9e81-482a3e0aa830 req-39c0fb31-12cb-4344-89c9-e9155ecd4fbe service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:26.480539 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-8197d283-728e-4e61-9e81-482a3e0aa830 req-39c0fb31-12cb-4344-89c9-e9155ecd4fbe service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:26.481680 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-8197d283-728e-4e61-9e81-482a3e0aa830 req-39c0fb31-12cb-4344-89c9-e9155ecd4fbe service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:26.505382 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-8197d283-728e-4e61-9e81-482a3e0aa830 req-39c0fb31-12cb-4344-89c9-e9155ecd4fbe service nova] Creating event network-vif-plugged:05830bf8-556a-469a-9d00-f97cadfd56ba for instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e on hv-cinder-85221 Aug 31 00:28:26.516108 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-8197d283-728e-4e61-9e81-482a3e0aa830 req-39c0fb31-12cb-4344-89c9-e9155ecd4fbe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066348 Aug 31 00:28:26.517482 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 441/897] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:26.931216 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-bcef67e1-79d5-4fc3-8fba-72f7d053ed28 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:26.934847 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-bcef67e1-79d5-4fc3-8fba-72f7d053ed28 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:26.941268 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bcef67e1-79d5-4fc3-8fba-72f7d053ed28 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:26.941859 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bcef67e1-79d5-4fc3-8fba-72f7d053ed28 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:26.942454 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bcef67e1-79d5-4fc3-8fba-72f7d053ed28 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:26.943334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bcef67e1-79d5-4fc3-8fba-72f7d053ed28 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:26.943922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bcef67e1-79d5-4fc3-8fba-72f7d053ed28 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:26.944469 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bcef67e1-79d5-4fc3-8fba-72f7d053ed28 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:26.986036 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-847d9f3e-e70d-42df-b851-0e98a1af4463 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:26.990386 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-847d9f3e-e70d-42df-b851-0e98a1af4463 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:27.011379 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-847d9f3e-e70d-42df-b851-0e98a1af4463 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:27.012763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-847d9f3e-e70d-42df-b851-0e98a1af4463 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:27.013906 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-847d9f3e-e70d-42df-b851-0e98a1af4463 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:27.016203 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-847d9f3e-e70d-42df-b851-0e98a1af4463 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:27.018242 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-847d9f3e-e70d-42df-b851-0e98a1af4463 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:27.019155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-847d9f3e-e70d-42df-b851-0e98a1af4463 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:27.632416 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-bcef67e1-79d5-4fc3-8fba-72f7d053ed28 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:27.643839 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-bcef67e1-79d5-4fc3-8fba-72f7d053ed28 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1678 microversion: 2.1 time: 0.717157 Aug 31 00:28:27.644801 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 457/898] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:26 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1678 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:27.656813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-847d9f3e-e70d-42df-b851-0e98a1af4463 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:27.672607 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-847d9f3e-e70d-42df-b851-0e98a1af4463 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.708033 Aug 31 00:28:27.673955 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 442/899] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:26 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:28.370990 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-c77b3e3d-7e5a-4723-b89c-053b0ae3794b req-ac2ddd17-3fde-474b-b0ed-7ca1a1e4288c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13034131-50e5-4af9-866a-d1886e4f1d1f", "name": "network-vif-deleted", "tag": "3bf14da9-ff0f-4d44-b9b5-dc459021416b"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:28.384516 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c77b3e3d-7e5a-4723-b89c-053b0ae3794b req-ac2ddd17-3fde-474b-b0ed-7ca1a1e4288c service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.385229 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c77b3e3d-7e5a-4723-b89c-053b0ae3794b req-ac2ddd17-3fde-474b-b0ed-7ca1a1e4288c service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.386129 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c77b3e3d-7e5a-4723-b89c-053b0ae3794b req-ac2ddd17-3fde-474b-b0ed-7ca1a1e4288c service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.408431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-c77b3e3d-7e5a-4723-b89c-053b0ae3794b req-ac2ddd17-3fde-474b-b0ed-7ca1a1e4288c service nova] Creating event network-vif-deleted:3bf14da9-ff0f-4d44-b9b5-dc459021416b for instance 13034131-50e5-4af9-866a-d1886e4f1d1f on hv-cinder-85221 Aug 31 00:28:28.420962 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-c77b3e3d-7e5a-4723-b89c-053b0ae3794b req-ac2ddd17-3fde-474b-b0ed-7ca1a1e4288c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054306 Aug 31 00:28:28.422492 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 458/900] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:28.671575 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:28.672658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:28.685148 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.686345 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.687368 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.688900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.689977 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.691370 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.714125 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4b64614b-5308-4121-bcb8-584899b9cffa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:28.717972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4b64614b-5308-4121-bcb8-584899b9cffa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:28.729235 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4b64614b-5308-4121-bcb8-584899b9cffa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.731023 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4b64614b-5308-4121-bcb8-584899b9cffa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.732495 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4b64614b-5308-4121-bcb8-584899b9cffa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.734949 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4b64614b-5308-4121-bcb8-584899b9cffa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.738419 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4b64614b-5308-4121-bcb8-584899b9cffa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.743114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4b64614b-5308-4121-bcb8-584899b9cffa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.775848 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.776990 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.777762 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.778758 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lazy-loading 'fault' on Instance uuid 13034131-50e5-4af9-866a-d1886e4f1d1f {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:28:28.838987 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:28.853428 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-73cdbe19-1978-47ff-9fa6-f1f8e11ac61a tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1330 microversion: 2.1 time: 0.189063 Aug 31 00:28:28.855384 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 443/901] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:28 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1330 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:29.050254 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4b64614b-5308-4121-bcb8-584899b9cffa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:29.061676 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4b64614b-5308-4121-bcb8-584899b9cffa tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1356 microversion: 2.1 time: 0.358287 Aug 31 00:28:29.068689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 459/902] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:28 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1356 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:29.887878 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:29.890391 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:29.915636 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:29.916642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:29.918729 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:29.920830 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:29.921858 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:29.922792 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:29.992589 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:29.993287 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:29.994194 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:29.994451 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lazy-loading 'fault' on Instance uuid 13034131-50e5-4af9-866a-d1886e4f1d1f {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:28:30.057261 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3da9d7af0fd4c1d99973e6b277b16d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe3f343119e4f10828c98ef17e8da5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:30.071784 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f58d0570-6897-4f11-938f-a551310474a8 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 200 len: 1330 microversion: 2.1 time: 0.191575 Aug 31 00:28:30.072432 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 444/903] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:29 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 1330 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:30.088481 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ae2ca93c-b270-4fe3-8fd7-65c32b7e72d6 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:30.090424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ae2ca93c-b270-4fe3-8fd7-65c32b7e72d6 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:30.100757 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2ca93c-b270-4fe3-8fd7-65c32b7e72d6 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.101653 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2ca93c-b270-4fe3-8fd7-65c32b7e72d6 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.104337 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2ca93c-b270-4fe3-8fd7-65c32b7e72d6 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.107440 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2ca93c-b270-4fe3-8fd7-65c32b7e72d6 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.107968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2ca93c-b270-4fe3-8fd7-65c32b7e72d6 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.108726 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ae2ca93c-b270-4fe3-8fd7-65c32b7e72d6 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.309633 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-ae2ca93c-b270-4fe3-8fd7-65c32b7e72d6 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:30.321753 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ae2ca93c-b270-4fe3-8fd7-65c32b7e72d6 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1546 microversion: 2.1 time: 0.237308 Aug 31 00:28:30.322610 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 460/904] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:30 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1546 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:30.350362 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4a69b710-b497-463d-a6bc-b9e85c505b85 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:30.351278 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4a69b710-b497-463d-a6bc-b9e85c505b85 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:30.360999 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a69b710-b497-463d-a6bc-b9e85c505b85 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.361708 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a69b710-b497-463d-a6bc-b9e85c505b85 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.362302 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a69b710-b497-463d-a6bc-b9e85c505b85 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.363201 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a69b710-b497-463d-a6bc-b9e85c505b85 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.363984 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a69b710-b497-463d-a6bc-b9e85c505b85 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.364642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a69b710-b497-463d-a6bc-b9e85c505b85 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.611197 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4a69b710-b497-463d-a6bc-b9e85c505b85 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:30.625684 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4a69b710-b497-463d-a6bc-b9e85c505b85 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1546 microversion: 2.1 time: 0.279131 Aug 31 00:28:30.626739 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 445/905] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:30 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1546 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:30.668780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e069e1bf-9252-4b55-bb37-d28c6642797b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:30.680897 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e069e1bf-9252-4b55-bb37-d28c6642797b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:30.681776 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e069e1bf-9252-4b55-bb37-d28c6642797b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Searching by: {'deleted': False, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6'} {{(pid=127118) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 00:28:30.692373 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e069e1bf-9252-4b55-bb37-d28c6642797b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.692861 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e069e1bf-9252-4b55-bb37-d28c6642797b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.693742 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e069e1bf-9252-4b55-bb37-d28c6642797b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.694713 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e069e1bf-9252-4b55-bb37-d28c6642797b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.695182 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e069e1bf-9252-4b55-bb37-d28c6642797b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.695696 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e069e1bf-9252-4b55-bb37-d28c6642797b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.801787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.multi_cell_list [None req-e069e1bf-9252-4b55-bb37-d28c6642797b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127118) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 00:28:30.912226 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e069e1bf-9252-4b55-bb37-d28c6642797b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.252715 Aug 31 00:28:30.912838 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 461/906] 10.222.0.47 () {58 vars in 1125 bytes} [Wed Aug 31 00:28:30 2022] GET /compute/v2.1/servers => generated 342 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:30.929271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-26c6078e-aed8-4aa9-82e6-ba382f34e5a3 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:30.930399 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-26c6078e-aed8-4aa9-82e6-ba382f34e5a3 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:30.942632 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26c6078e-aed8-4aa9-82e6-ba382f34e5a3 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.943342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26c6078e-aed8-4aa9-82e6-ba382f34e5a3 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.944119 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26c6078e-aed8-4aa9-82e6-ba382f34e5a3 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.945380 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26c6078e-aed8-4aa9-82e6-ba382f34e5a3 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.946192 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26c6078e-aed8-4aa9-82e6-ba382f34e5a3 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.946938 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-26c6078e-aed8-4aa9-82e6-ba382f34e5a3 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:31.107877 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:31.108639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:31.115446 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:31.116024 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:31.116553 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:31.117293 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:31.117853 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:31.118338 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:31.130326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-26c6078e-aed8-4aa9-82e6-ba382f34e5a3 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:31.135106 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f HTTP/1.1 Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:28:31.137667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:31.140533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '13034131-50e5-4af9-866a-d1886e4f1d1f'} Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:31.142025 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:31.144527 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:31.147010 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:31.147010 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7e40a4f1-cdf3-4922-bb21-da22119d0226 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 404 len: 111 microversion: 2.1 time: 0.036199 Aug 31 00:28:31.147010 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 462/907] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:31 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:31.151065 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-26c6078e-aed8-4aa9-82e6-ba382f34e5a3 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1546 microversion: 2.1 time: 0.228831 Aug 31 00:28:31.152193 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 446/908] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:30 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1546 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:31.154956 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7ae21c8a-12de-41ae-82ee-4921bc0d7549 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '.version_select at 0x7f1a3a7814c0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:31.185322 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7ae21c8a-12de-41ae-82ee-4921bc0d7549 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134613055" status: 202 len: 0 microversion: 2.1 time: 0.037758 Aug 31 00:28:31.185918 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 463/909] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Aug 31 00:28:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134613055 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:28:32.845224 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-52e49c1b-01b5-4bef-8120-f6ceddf9e8e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63cab0c7-76df-432f-8240-889e82e3812c"}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:32.847860 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-52e49c1b-01b5-4bef-8120-f6ceddf9e8e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:32.855336 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-52e49c1b-01b5-4bef-8120-f6ceddf9e8e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:32.855829 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-52e49c1b-01b5-4bef-8120-f6ceddf9e8e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:32.856305 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-52e49c1b-01b5-4bef-8120-f6ceddf9e8e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:32.857026 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-52e49c1b-01b5-4bef-8120-f6ceddf9e8e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:32.857481 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-52e49c1b-01b5-4bef-8120-f6ceddf9e8e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:32.857940 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-52e49c1b-01b5-4bef-8120-f6ceddf9e8e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.205331 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-52e49c1b-01b5-4bef-8120-f6ceddf9e8e4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "POST /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365199 Aug 31 00:28:33.206117 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 447/910] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 31 00:28:32 2022] POST /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:28:33.680761 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:33.681641 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:33.694703 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.695592 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.696406 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.697643 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.698516 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.700453 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.727734 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: DELETE /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f HTTP/1.1 Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:28:33.731113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:33.732960 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '13034131-50e5-4af9-866a-d1886e4f1d1f'} Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:33.733912 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:33.735428 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:33.736956 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:33.736956 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-ea264d0a-68d4-4b16-902f-ca4ba9baaa72 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 404 len: 111 microversion: 2.1 time: 0.060362 Aug 31 00:28:33.736956 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 464/911] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:28:33 2022] DELETE /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:33.745168 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:33.745909 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 13034131-50e5-4af9-866a-d1886e4f1d1f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:33.753984 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.754683 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.755295 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.756108 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.756710 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.757239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.773696 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f HTTP/1.1 Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:28:33.775427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:33.778886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '13034131-50e5-4af9-866a-d1886e4f1d1f'} Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:33.780694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. Aug 31 00:28:33.783510 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:33.785941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 13034131-50e5-4af9-866a-d1886e4f1d1f could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:33.785941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7dd90343-db65-4ee0-97df-96326c526cf0 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f" status: 404 len: 111 microversion: 2.1 time: 0.036691 Aug 31 00:28:33.785941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 448/912] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:33 2022] GET /compute/v2.1/servers/13034131-50e5-4af9-866a-d1886e4f1d1f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:37.102649 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:37.104300 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:37.114479 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.115486 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.116373 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.118459 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.119038 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.119646 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.141834 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: DELETE /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 HTTP/1.1 Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:28:37.143792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:28:37.147188 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '599f96bf-1137-4129-af25-5d61b32a4349'} Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:37.149616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:28:37.153138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.156471 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:37.156471 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f3441eed-5946-40f1-9305-47be656fd9ae tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 404 len: 111 microversion: 2.1 time: 0.047706 Aug 31 00:28:37.156471 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 465/913] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:28:37 2022] DELETE /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:37.160976 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:37.161624 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 599f96bf-1137-4129-af25-5d61b32a4349] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:37.170841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.171524 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.172435 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.173422 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.174000 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.174542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.196224 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 HTTP/1.1 Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:28:37.199438 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:28:37.201158 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '599f96bf-1137-4129-af25-5d61b32a4349'} Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:37.201937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. Aug 31 00:28:37.204221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.206267 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 599f96bf-1137-4129-af25-5d61b32a4349 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:37.206267 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-75230726-9125-4eec-96a4-9b1e6a6f94e3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349" status: 404 len: 111 microversion: 2.1 time: 0.047665 Aug 31 00:28:37.206267 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 449/914] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:37 2022] GET /compute/v2.1/servers/599f96bf-1137-4129-af25-5d61b32a4349 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:37.212673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:37.213262 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:37.222742 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.223630 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.224421 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.225938 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.226733 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.227475 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.257385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: DELETE /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 HTTP/1.1 Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:28:37.260896 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:28:37.264143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '8fdf4278-aa30-4d1a-8c4d-94afd592aba5'} Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:37.266464 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:28:37.269434 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.273037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:37.273037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-be7ec7ef-7120-46e7-8226-e36094fcd23e tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 404 len: 111 microversion: 2.1 time: 0.055281 Aug 31 00:28:37.273037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 466/915] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:28:37 2022] DELETE /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:37.282823 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:37.283795 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 8fdf4278-aa30-4d1a-8c4d-94afd592aba5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:37.292730 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.293135 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.293700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.294509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.294909 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.295338 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.321596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 HTTP/1.1 Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:28:37.326079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:28:37.327703 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '8fdf4278-aa30-4d1a-8c4d-94afd592aba5'} Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:37.328571 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. Aug 31 00:28:37.329833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:37.331027 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 8fdf4278-aa30-4d1a-8c4d-94afd592aba5 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:37.331027 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ca34099a-82e0-4acc-9310-9887ae3205c5 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5" status: 404 len: 111 microversion: 2.1 time: 0.052051 Aug 31 00:28:37.331027 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 450/916] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:37 2022] GET /compute/v2.1/servers/8fdf4278-aa30-4d1a-8c4d-94afd592aba5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:38.527782 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:38.528701 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:38.539298 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:38.540087 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:38.540847 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:38.542029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:38.542921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:38.543702 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:38.554204 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:38.565804 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: DELETE /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 HTTP/1.1 Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:28:38.567885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:28:38.571029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '1d377dbb-6731-491e-bc79-3c63e6eb99a0'} Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:38.573064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:28:38.577092 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:38.581597 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:38.581597 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-bf250d58-5476-48cf-86ff-6e3a610fd1d3 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 404 len: 111 microversion: 2.1 time: 0.049779 Aug 31 00:28:38.581597 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 467/917] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:28:38 2022] DELETE /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:38.584988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:38.586067 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] [instance: 1d377dbb-6731-491e-bc79-3c63e6eb99a0] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:38.590602 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:38.599737 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:38.600371 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:38.600961 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:38.601825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:38.602450 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:38.603050 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:38.623644 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] HTTP exception thrown: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Request method failure captured: Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 HTTP/1.1 Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqlYAt-CC3A3c6aQDfF0ACPOYY1JvtmOWWWYGbnzTyYppZ9ztg97z3-9l_4DYVQ6DH2vjt4FYkvP5tzM8EsWde69vQ87ktc5Fa-ILaF55eyHU6qk5MYtRpeIdWXmS-9qym3u1XJ1Nop8AzUXnRch6nOeaKlPSwaTCMprjy9hTNqYNow Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:28:38.625208 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dbe3f343119e4f10828c98ef17e8da5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dbe3f343119e4f10828c98ef17e8da5c"}]}] Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: dbe3f343119e4f10828c98ef17e8da5c Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-36051184 Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: b3da9d7af0fd4c1d99973e6b277b16d2 Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-AttachVolumeNegativeTest-36051184-project Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:28:38.627788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '1d377dbb-6731-491e-bc79-3c63e6eb99a0'} Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:38.629713 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. Aug 31 00:28:38.634904 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:28:38.641174 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] Returning 404 to user: Instance 1d377dbb-6731-491e-bc79-3c63e6eb99a0 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:38.641174 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c9fd691b-50b1-4353-a286-e64a288b4be1 tempest-AttachVolumeNegativeTest-36051184 tempest-AttachVolumeNegativeTest-36051184-project] 10.222.0.47 "GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0" status: 404 len: 111 microversion: 2.1 time: 0.048133 Aug 31 00:28:38.641174 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 451/918] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:38 2022] GET /compute/v2.1/servers/1d377dbb-6731-491e-bc79-3c63e6eb99a0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:28:44.467885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c592a45f-689d-4724-9e7d-74eb119ae8c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:44.468928 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c592a45f-689d-4724-9e7d-74eb119ae8c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:44.471224 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:44.472227 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:44.483533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c592a45f-689d-4724-9e7d-74eb119ae8c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:44.484385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c592a45f-689d-4724-9e7d-74eb119ae8c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:44.484823 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c592a45f-689d-4724-9e7d-74eb119ae8c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:44.485548 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c592a45f-689d-4724-9e7d-74eb119ae8c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:44.486006 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c592a45f-689d-4724-9e7d-74eb119ae8c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:44.486427 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c592a45f-689d-4724-9e7d-74eb119ae8c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:44.875753 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c592a45f-689d-4724-9e7d-74eb119ae8c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:44.887802 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c592a45f-689d-4724-9e7d-74eb119ae8c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1592 microversion: 2.1 time: 0.424022 Aug 31 00:28:44.889211 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 468/919] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:44 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1592 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:45.674028 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-dd5a33e6-0909-4045-9eb1-5e04ad928dd7 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] Action: 'create', calling method: .version_select at 0x7f1a3a876af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-29105605", "metadata": {"Type": "work"}}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:46.226654 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-dd5a33e6-0909-4045-9eb1-5e04ad928dd7 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.776781 Aug 31 00:28:46.227733 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 452/920] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 31 00:28:45 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 780 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 00:28:46.249446 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-6f6c25b1-592a-49a4-99af-7e24c2204b77 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] Calling method '.version_select at 0x7f1a3a7be5e0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:46.342441 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-6f6c25b1-592a-49a4-99af-7e24c2204b77 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c" status: 200 len: 351 microversion: 2.1 time: 0.103691 Aug 31 00:28:46.343518 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 469/921] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:28:46 2022] GET /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:28:47.366193 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-525858ac-0f46-46d5-b48a-8b84e66db73e tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] Calling method '.version_select at 0x7f1a3a8df550>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:47.480314 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-525858ac-0f46-46d5-b48a-8b84e66db73e tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c" status: 200 len: 352 microversion: 2.1 time: 0.120668 Aug 31 00:28:47.481382 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 453/922] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:28:47 2022] GET /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:47.498236 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e2fea382-3355-4cab-82a3-17175c9a7e6a tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] Calling method '.version_select at 0x7f1a3a7890d0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:47.585455 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e2fea382-3355-4cab-82a3-17175c9a7e6a tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c" status: 200 len: 352 microversion: 2.1 time: 0.092963 Aug 31 00:28:47.586810 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 470/923] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:28:47 2022] GET /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:28:47.623767 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5962c703-e57c-48d0-9719-7471f7e7b228 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] Calling method '.version_select at 0x7f1a3a7925e0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:47.747786 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5962c703-e57c-48d0-9719-7471f7e7b228 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c" status: 202 len: 0 microversion: 2.1 time: 0.130508 Aug 31 00:28:47.749397 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 454/924] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 31 00:28:47 2022] DELETE /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:28:47.762236 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-6e58d738-20c5-47a7-b0d3-375ee6df5120 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] Calling method '.version_select at 0x7f1a3a7af8b0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:47.861621 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-6e58d738-20c5-47a7-b0d3-375ee6df5120 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c" status: 200 len: 351 microversion: 2.1 time: 0.105143 Aug 31 00:28:47.862360 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 471/925] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:28:47 2022] GET /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:48.170542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-bd99eb82-515b-4da8-8a32-44c67cccab6b req-53180fd3-c830-44e2-8474-dc1e42179058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e", "tag": "05830bf8-556a-469a-9d00-f97cadfd56ba"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:48.182193 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-bd99eb82-515b-4da8-8a32-44c67cccab6b req-53180fd3-c830-44e2-8474-dc1e42179058 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:48.183484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-bd99eb82-515b-4da8-8a32-44c67cccab6b req-53180fd3-c830-44e2-8474-dc1e42179058 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:48.184406 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-bd99eb82-515b-4da8-8a32-44c67cccab6b req-53180fd3-c830-44e2-8474-dc1e42179058 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:48.201740 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-bd99eb82-515b-4da8-8a32-44c67cccab6b req-53180fd3-c830-44e2-8474-dc1e42179058 service nova] Creating event network-changed:05830bf8-556a-469a-9d00-f97cadfd56ba for instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e on hv-cinder-85221 Aug 31 00:28:48.208716 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-bd99eb82-515b-4da8-8a32-44c67cccab6b req-53180fd3-c830-44e2-8474-dc1e42179058 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042128 Aug 31 00:28:48.214342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 455/926] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:28:48.891811 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-304b3584-ccb3-4105-bf12-10f0753b12f0 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] Calling method '.version_select at 0x7f1a3a789940>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:48.962348 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-304b3584-ccb3-4105-bf12-10f0753b12f0 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] HTTP exception thrown: Volume a179dc46-8eb9-4784-9777-c2fe43e2616c could not be found. Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-304b3584-ccb3-4105-bf12-10f0753b12f0 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] Request method failure captured: Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c HTTP/1.1 Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqs90ZflJVaJcFslar1QmBma_P8SQLsrTdXW5y3oaaWxtnLv6uyOP-963TLL1BHLomERRzx1u8NgmLd-Mzpu6J3oYAZ7OCLDJ1k1C-DmGlry6zao6X0K5PrmETznDEn6ESxk8d0K7x7gB2L135hEFjAq-XWvVjJ7gk-PYrSeIUaTlJE Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 9be311dad5aa45d88d32fa7065ba72c9 Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-VolumesGetTestJSON-455456787 Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:28:48.967016 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9be311dad5aa45d88d32fa7065ba72c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9be311dad5aa45d88d32fa7065ba72c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9be311dad5aa45d88d32fa7065ba72c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9be311dad5aa45d88d32fa7065ba72c9"}]}] Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-VolumesGetTestJSON-455456787 Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 9be311dad5aa45d88d32fa7065ba72c9 Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-VolumesGetTestJSON-455456787 Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-VolumesGetTestJSON-455456787-project Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 15d6f9c21aac456b9fa06f76042f7ff3 Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-VolumesGetTestJSON-455456787-project Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Volume a179dc46-8eb9-4784-9777-c2fe43e2616c could not be found. Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'a179dc46-8eb9-4784-9777-c2fe43e2616c'} Aug 31 00:28:48.970279 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a179dc46-8eb9-4784-9777-c2fe43e2616c could not be found. (HTTP 404) (Request-ID: req-c48a877e-750f-4ff1-a08c-380bbbfa8a5c) Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:48.972584 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:28:48.974426 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a179dc46-8eb9-4784-9777-c2fe43e2616c could not be found. Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:28:48.975872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a179dc46-8eb9-4784-9777-c2fe43e2616c could not be found. Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a179dc46-8eb9-4784-9777-c2fe43e2616c could not be found. Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-304b3584-ccb3-4105-bf12-10f0753b12f0 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] Returning 404 to user: Volume a179dc46-8eb9-4784-9777-c2fe43e2616c could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:48.978334 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-304b3584-ccb3-4105-bf12-10f0753b12f0 tempest-VolumesGetTestJSON-455456787 tempest-VolumesGetTestJSON-455456787-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c" status: 404 len: 109 microversion: 2.1 time: 0.099415 Aug 31 00:28:48.984387 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 472/927] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:28:48 2022] GET /compute/v2.1/os-volumes/a179dc46-8eb9-4784-9777-c2fe43e2616c => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:50.178814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3822ddb5-76ef-4bf9-bf01-c1f650ea8998 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1821979224"}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:50.179528 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3822ddb5-76ef-4bf9-bf01-c1f650ea8998 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:50.187400 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3822ddb5-76ef-4bf9-bf01-c1f650ea8998 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:50.188274 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3822ddb5-76ef-4bf9-bf01-c1f650ea8998 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:50.188986 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3822ddb5-76ef-4bf9-bf01-c1f650ea8998 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:50.190369 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3822ddb5-76ef-4bf9-bf01-c1f650ea8998 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:50.191177 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3822ddb5-76ef-4bf9-bf01-c1f650ea8998 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:50.191763 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3822ddb5-76ef-4bf9-bf01-c1f650ea8998 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:50.372129 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.network.security_group_api [None req-3822ddb5-76ef-4bf9-bf01-c1f650ea8998 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Adding security group e9405b4c-01ab-49c0-90c5-9e0a220dfb7a to port 05830bf8-556a-469a-9d00-f97cadfd56ba Aug 31 00:28:51.275710 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3822ddb5-76ef-4bf9-bf01-c1f650ea8998 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "POST /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/action" status: 202 len: 0 microversion: 2.1 time: 1.101465 Aug 31 00:28:51.280879 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 456/928] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:28:50 2022] POST /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/action => generated 0 bytes in 1110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:28:51.287700 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e873c54c-e30e-4e24-9ea3-6c60c4191659 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:51.288697 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e873c54c-e30e-4e24-9ea3-6c60c4191659 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:51.289114 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-3f245c2a-2452-4f83-9e06-52533e3b88b1 req-8d92d7e5-3c3a-4365-bef4-9b88d39bdc99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e", "tag": "05830bf8-556a-469a-9d00-f97cadfd56ba"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:51.297517 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e873c54c-e30e-4e24-9ea3-6c60c4191659 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:51.298484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e873c54c-e30e-4e24-9ea3-6c60c4191659 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:51.299365 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e873c54c-e30e-4e24-9ea3-6c60c4191659 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:51.301073 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e873c54c-e30e-4e24-9ea3-6c60c4191659 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:51.301687 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e873c54c-e30e-4e24-9ea3-6c60c4191659 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:51.302295 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e873c54c-e30e-4e24-9ea3-6c60c4191659 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:51.314076 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3f245c2a-2452-4f83-9e06-52533e3b88b1 req-8d92d7e5-3c3a-4365-bef4-9b88d39bdc99 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:51.315110 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3f245c2a-2452-4f83-9e06-52533e3b88b1 req-8d92d7e5-3c3a-4365-bef4-9b88d39bdc99 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:51.315871 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3f245c2a-2452-4f83-9e06-52533e3b88b1 req-8d92d7e5-3c3a-4365-bef4-9b88d39bdc99 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:51.342796 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-3f245c2a-2452-4f83-9e06-52533e3b88b1 req-8d92d7e5-3c3a-4365-bef4-9b88d39bdc99 service nova] Creating event network-changed:05830bf8-556a-469a-9d00-f97cadfd56ba for instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e on hv-cinder-85221 Aug 31 00:28:51.353430 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-3f245c2a-2452-4f83-9e06-52533e3b88b1 req-8d92d7e5-3c3a-4365-bef4-9b88d39bdc99 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072920 Aug 31 00:28:51.354450 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 473/929] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:51.544245 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e873c54c-e30e-4e24-9ea3-6c60c4191659 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:51.559395 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e873c54c-e30e-4e24-9ea3-6c60c4191659 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1758 microversion: 2.1 time: 0.277103 Aug 31 00:28:51.560717 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 457/930] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:51 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1758 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:58.394606 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2b675574-0d5b-48f7-aca2-daca33dd9636 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:58.399448 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2b675574-0d5b-48f7-aca2-daca33dd9636 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:58.412393 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b675574-0d5b-48f7-aca2-daca33dd9636 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:58.413218 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b675574-0d5b-48f7-aca2-daca33dd9636 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:58.413968 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b675574-0d5b-48f7-aca2-daca33dd9636 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:58.415229 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b675574-0d5b-48f7-aca2-daca33dd9636 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:58.416494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b675574-0d5b-48f7-aca2-daca33dd9636 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:58.416884 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2b675574-0d5b-48f7-aca2-daca33dd9636 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:58.470293 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2b675574-0d5b-48f7-aca2-daca33dd9636 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.086884 Aug 31 00:28:58.471522 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 474/931] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 31 00:28:58 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:58.545008 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-fb944060-ac40-45d2-94c0-2d02b0bd137a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:58.545887 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-fb944060-ac40-45d2-94c0-2d02b0bd137a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:58.554656 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb944060-ac40-45d2-94c0-2d02b0bd137a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:58.555169 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb944060-ac40-45d2-94c0-2d02b0bd137a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:58.555645 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb944060-ac40-45d2-94c0-2d02b0bd137a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:58.556454 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb944060-ac40-45d2-94c0-2d02b0bd137a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:58.556919 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb944060-ac40-45d2-94c0-2d02b0bd137a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:58.557354 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-fb944060-ac40-45d2-94c0-2d02b0bd137a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:58.561280 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:58.612337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-fb944060-ac40-45d2-94c0-2d02b0bd137a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:28:58.757487 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-fb944060-ac40-45d2-94c0-2d02b0bd137a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "DELETE /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 204 len: 0 microversion: 2.20 time: 0.216396 Aug 31 00:28:58.758404 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 458/932] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 31 00:28:58 2022] DELETE /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 00:28:58.770164 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:58.771437 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:58.780541 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:58.781489 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:58.781979 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:58.782789 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:58.783394 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:58.783901 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:58.946173 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:58.958612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:58.961219 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:58.962958 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c5cfddde-afec-48d1-8f7b-237bbf05a286 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.199214 Aug 31 00:28:58.964843 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 475/933] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:58 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:29:00.002999 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:00.004270 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:00.015436 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:00.015810 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:00.016493 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:00.017717 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:00.018372 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:00.019115 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:00.229736 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:00.243116 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:00.244176 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:00.246330 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-37e5eeec-28ab-4e89-8b14-b7559dd6f0bc tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1724 microversion: 2.20 time: 0.250394 Aug 31 00:29:00.246933 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 459/934] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:28:59 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:29:01.290379 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:01.293124 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:01.310002 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:01.311316 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:01.312472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:01.314174 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:01.315272 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:01.316312 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:01.507119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:01.524749 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:01.529591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:01.532035 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1e3f9c6a-7414-4700-ae2f-0f2259bb6ed6 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1656 microversion: 2.20 time: 0.250432 Aug 31 00:29:01.540251 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 476/935] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:29:01 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1656 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:29:01.869918 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-1d3fb6d3-82ed-4b0c-92ec-83e7f945cb05 req-3e19c584-40f2-47a4-ad1c-e88609583830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698d47ed-0a7a-4601-87a9-beb0597d3045", "name": "network-vif-deleted", "tag": "9e1236d0-86cd-45da-a9dc-878f6a1707a4"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:01.894027 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-1d3fb6d3-82ed-4b0c-92ec-83e7f945cb05 req-3e19c584-40f2-47a4-ad1c-e88609583830 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:01.894855 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-1d3fb6d3-82ed-4b0c-92ec-83e7f945cb05 req-3e19c584-40f2-47a4-ad1c-e88609583830 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:01.895614 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-1d3fb6d3-82ed-4b0c-92ec-83e7f945cb05 req-3e19c584-40f2-47a4-ad1c-e88609583830 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:01.923758 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-1d3fb6d3-82ed-4b0c-92ec-83e7f945cb05 req-3e19c584-40f2-47a4-ad1c-e88609583830 service nova] Creating event network-vif-deleted:9e1236d0-86cd-45da-a9dc-878f6a1707a4 for instance 698d47ed-0a7a-4601-87a9-beb0597d3045 on hv-cinder-85221 Aug 31 00:29:01.936845 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-1d3fb6d3-82ed-4b0c-92ec-83e7f945cb05 req-3e19c584-40f2-47a4-ad1c-e88609583830 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074085 Aug 31 00:29:01.943219 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 460/936] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:02.566530 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:02.570070 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:02.591519 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:02.593935 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:02.596908 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:02.599306 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:02.601736 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:02.603066 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:02.675811 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:02.676623 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:02.677349 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:02.679162 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lazy-loading 'fault' on Instance uuid 698d47ed-0a7a-4601-87a9-beb0597d3045 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:29:02.757280 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:02.778125 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:02.783414 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08fa033114244fc89c82939202f911e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c8a6e81fe48d5b9609b921283e64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:02.795777 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-afae60cb-9ce9-4fc7-9e9d-d803fcfb593d tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 200 len: 1372 microversion: 2.20 time: 0.237704 Aug 31 00:29:02.814723 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 477/937] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:29:02 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:29:03.846246 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:03.849629 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:03.859935 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:03.860683 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:03.861368 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:03.862289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:03.863313 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:03.867692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:03.889941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] HTTP exception thrown: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Request method failure captured: Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 HTTP/1.1 Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqlN9q7z7viVpTDrCziXrueDBfp2zIreU5Mi0KRdhR70wVGfMol1XmEB1_TCk5V4D51BjqZDl-T5o07DhI6h4yqdYIfgF3f0ulAoHz6nUujV97cUWzRjZWAtped83SO-w9CvIaSIpVO32tt9lfqj90idLLV-zC2LMExeHTIDW2bMEkE Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:29:03.892393 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e53c8a6e81fe48d5b9609b921283e64d"}]}] Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: 08fa033114244fc89c82939202f911e7 Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:03.895548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '698d47ed-0a7a-4601-87a9-beb0597d3045'} Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:03.897111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:03.899813 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:03.904389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Returning 404 to user: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:03.904389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7192e41f-514a-4680-b9ab-2a8d9e03db91 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 404 len: 111 microversion: 2.20 time: 0.053955 Aug 31 00:29:03.904389 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 461/938] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:29:03 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:29:03.910649 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-23cdecaa-0dae-48e7-b94f-e9f264a4fa74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '.version_select at 0x7f1a3a852b80>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:03.951454 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-23cdecaa-0dae-48e7-b94f-e9f264a4fa74 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905310872" status: 204 len: 0 microversion: 2.20 time: 0.047306 Aug 31 00:29:03.953004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 478/939] 10.222.0.47 () {60 vars in 1262 bytes} [Wed Aug 31 00:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905310872 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 00:29:06.469559 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:06.470371 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:06.487194 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:06.488108 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:06.488787 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:06.490270 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:06.491078 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:06.491833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:06.529064 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] HTTP exception thrown: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Request method failure captured: Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: DELETE /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 HTTP/1.1 Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqlN9q7z7viVpTDrCziXrueDBfp2zIreU5Mi0KRdhR70wVGfMol1XmEB1_TCk5V4D51BjqZDl-T5o07DhI6h4yqdYIfgF3f0ulAoHz6nUujV97cUWzRjZWAtped83SO-w9CvIaSIpVO32tt9lfqj90idLLV-zC2LMExeHTIDW2bMEkE Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:29:06.531728 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e53c8a6e81fe48d5b9609b921283e64d"}]}] Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: 08fa033114244fc89c82939202f911e7 Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:06.533542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '698d47ed-0a7a-4601-87a9-beb0597d3045'} Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:06.534449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:06.535950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:06.537533 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Returning 404 to user: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:06.537533 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-02959a33-1ea7-4c4d-a6ab-b3e14dd0d9a3 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "DELETE /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 404 len: 111 microversion: 2.20 time: 0.073499 Aug 31 00:29:06.537533 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 462/940] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 31 00:29:06 2022] DELETE /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:29:06.547571 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:06.548367 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: 698d47ed-0a7a-4601-87a9-beb0597d3045] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:06.555787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:06.556377 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:06.556809 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:06.558194 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:06.558644 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:06.559175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:06.576741 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] HTTP exception thrown: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Request method failure captured: Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 HTTP/1.1 Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlN9q7z7viVpTDrCziXrueDBfp2zIreU5Mi0KRdhR70wVGfMol1XmEB1_TCk5V4D51BjqZDl-T5o07DhI6h4yqdYIfgF3f0ulAoHz6nUujV97cUWzRjZWAtped83SO-w9CvIaSIpVO32tt9lfqj90idLLV-zC2LMExeHTIDW2bMEkE Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:29:06.578432 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e53c8a6e81fe48d5b9609b921283e64d"}]}] Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 08fa033114244fc89c82939202f911e7 Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:06.581399 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '698d47ed-0a7a-4601-87a9-beb0597d3045'} Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:06.583612 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. Aug 31 00:29:06.586629 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:06.590074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Returning 404 to user: Instance 698d47ed-0a7a-4601-87a9-beb0597d3045 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:06.590074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a7825df8-0848-41ce-bae3-ea00e792428a tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045" status: 404 len: 111 microversion: 2.20 time: 0.036786 Aug 31 00:29:06.590074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 479/941] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:29:06 2022] GET /compute/v2.1/servers/698d47ed-0a7a-4601-87a9-beb0597d3045 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 00:29:07.366502 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-0a4bc053-340a-4242-8de6-e730a02c6662 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:07.367495 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-0a4bc053-340a-4242-8de6-e730a02c6662 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:07.378392 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0a4bc053-340a-4242-8de6-e730a02c6662 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:07.379293 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0a4bc053-340a-4242-8de6-e730a02c6662 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:07.380836 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0a4bc053-340a-4242-8de6-e730a02c6662 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.381656 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0a4bc053-340a-4242-8de6-e730a02c6662 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:07.382377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0a4bc053-340a-4242-8de6-e730a02c6662 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:07.382910 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0a4bc053-340a-4242-8de6-e730a02c6662 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.423449 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-0a4bc053-340a-4242-8de6-e730a02c6662 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:29:07.545475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-0a4bc053-340a-4242-8de6-e730a02c6662 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 204 len: 0 microversion: 2.1 time: 0.183417 Aug 31 00:29:07.546838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 463/942] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:29:07 2022] DELETE /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:29:07.561825 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-cd4c13de-1c80-4d96-851e-ee2b3641e673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:07.565336 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-cd4c13de-1c80-4d96-851e-ee2b3641e673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:07.580267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd4c13de-1c80-4d96-851e-ee2b3641e673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:07.582227 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd4c13de-1c80-4d96-851e-ee2b3641e673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:07.584259 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd4c13de-1c80-4d96-851e-ee2b3641e673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.585924 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd4c13de-1c80-4d96-851e-ee2b3641e673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:07.586993 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd4c13de-1c80-4d96-851e-ee2b3641e673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:07.588045 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cd4c13de-1c80-4d96-851e-ee2b3641e673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.810764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:07.813024 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:07.825446 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:07.826240 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:07.827022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.828567 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:07.829281 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:07.831039 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.842801 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-cd4c13de-1c80-4d96-851e-ee2b3641e673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:07.856804 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] HTTP exception thrown: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Request method failure captured: Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: DELETE /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 HTTP/1.1 Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqlN9q7z7viVpTDrCziXrueDBfp2zIreU5Mi0KRdhR70wVGfMol1XmEB1_TCk5V4D51BjqZDl-T5o07DhI6h4yqdYIfgF3f0ulAoHz6nUujV97cUWzRjZWAtped83SO-w9CvIaSIpVO32tt9lfqj90idLLV-zC2LMExeHTIDW2bMEkE Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:29:07.859043 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e53c8a6e81fe48d5b9609b921283e64d"}]}] Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: 08fa033114244fc89c82939202f911e7 Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:29:07.861004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': 'e3a312d8-6cb2-4da8-a19b-215372294799'} Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:07.862385 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:29:07.866568 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:07.868107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-cd4c13de-1c80-4d96-851e-ee2b3641e673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1577 microversion: 2.1 time: 0.310777 Aug 31 00:29:07.870492 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Returning 404 to user: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:07.875284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4845df9a-9c5c-4ea4-8d94-c5a7691e7a04 tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 404 len: 111 microversion: 2.20 time: 0.074391 Aug 31 00:29:07.882020 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 480/943] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:07 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1577 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:07.884746 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 464/944] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 31 00:29:07 2022] DELETE /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:29:07.890373 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:07.891390 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] [instance: e3a312d8-6cb2-4da8-a19b-215372294799] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:07.898472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:07.898962 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:07.899396 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.900138 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:07.900648 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:07.901617 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.919336 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] HTTP exception thrown: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Request method failure captured: Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 HTTP/1.1 Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqlN9q7z7viVpTDrCziXrueDBfp2zIreU5Mi0KRdhR70wVGfMol1XmEB1_TCk5V4D51BjqZDl-T5o07DhI6h4yqdYIfgF3f0ulAoHz6nUujV97cUWzRjZWAtped83SO-w9CvIaSIpVO32tt9lfqj90idLLV-zC2LMExeHTIDW2bMEkE Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:29:07.920986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53c8a6e81fe48d5b9609b921283e64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e53c8a6e81fe48d5b9609b921283e64d"}]}] Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: e53c8a6e81fe48d5b9609b921283e64d Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-302852479 Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 08fa033114244fc89c82939202f911e7 Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-AttachVolumeShelveTestJSON-302852479-project Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:29:07.924098 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'e3a312d8-6cb2-4da8-a19b-215372294799'} Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:07.926083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. Aug 31 00:29:07.930832 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:07.935460 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] Returning 404 to user: Instance e3a312d8-6cb2-4da8-a19b-215372294799 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:07.935460 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-51251e3a-9dca-4f1d-9a6d-8b9d95d4879e tempest-AttachVolumeShelveTestJSON-302852479 tempest-AttachVolumeShelveTestJSON-302852479-project] 10.222.0.47 "GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799" status: 404 len: 111 microversion: 2.20 time: 0.039859 Aug 31 00:29:07.935460 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 481/945] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 31 00:29:07 2022] GET /compute/v2.1/servers/e3a312d8-6cb2-4da8-a19b-215372294799 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:29:08.922619 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b8689588-6e42-44ab-ae47-02496727096f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:08.923587 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b8689588-6e42-44ab-ae47-02496727096f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:08.937422 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:08.938962 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8689588-6e42-44ab-ae47-02496727096f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:08.943311 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8689588-6e42-44ab-ae47-02496727096f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:08.943774 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8689588-6e42-44ab-ae47-02496727096f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:08.944724 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8689588-6e42-44ab-ae47-02496727096f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:08.945551 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8689588-6e42-44ab-ae47-02496727096f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:08.946162 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b8689588-6e42-44ab-ae47-02496727096f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:09.336824 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-b8689588-6e42-44ab-ae47-02496727096f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:09.353173 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b8689588-6e42-44ab-ae47-02496727096f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1577 microversion: 2.1 time: 0.452118 Aug 31 00:29:09.353953 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 465/946] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:08 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1577 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:09.562704 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b890c4fd-de4e-4a35-a4d6-6478dcabc1d4 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:09.564274 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b890c4fd-de4e-4a35-a4d6-6478dcabc1d4 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:09.574582 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b890c4fd-de4e-4a35-a4d6-6478dcabc1d4 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:09.578291 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b890c4fd-de4e-4a35-a4d6-6478dcabc1d4 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:09.580565 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b890c4fd-de4e-4a35-a4d6-6478dcabc1d4 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:09.582747 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b890c4fd-de4e-4a35-a4d6-6478dcabc1d4 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:09.586065 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b890c4fd-de4e-4a35-a4d6-6478dcabc1d4 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:09.587731 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b890c4fd-de4e-4a35-a4d6-6478dcabc1d4 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:09.589518 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-cf71fd95-24b1-4956-a913-bab0e0293f41 req-f3c4c92f-1c87-4760-9492-2fb6ddb90472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95e1f70-6a63-40b2-a053-4b043f6b1ffa", "tag": "c156e592-123d-470f-843d-661d21c8d777"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:09.621651 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-cf71fd95-24b1-4956-a913-bab0e0293f41 req-f3c4c92f-1c87-4760-9492-2fb6ddb90472 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:09.622651 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-cf71fd95-24b1-4956-a913-bab0e0293f41 req-f3c4c92f-1c87-4760-9492-2fb6ddb90472 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:09.626030 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-cf71fd95-24b1-4956-a913-bab0e0293f41 req-f3c4c92f-1c87-4760-9492-2fb6ddb90472 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:09.648120 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b890c4fd-de4e-4a35-a4d6-6478dcabc1d4 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Going to try to terminate instance {{(pid=127118) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:29:09.656812 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-cf71fd95-24b1-4956-a913-bab0e0293f41 req-f3c4c92f-1c87-4760-9492-2fb6ddb90472 service nova] Creating event network-changed:c156e592-123d-470f-843d-661d21c8d777 for instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa on hv-cinder-85221 Aug 31 00:29:09.666135 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-cf71fd95-24b1-4956-a913-bab0e0293f41 req-f3c4c92f-1c87-4760-9492-2fb6ddb90472 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087698 Aug 31 00:29:09.667677 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 466/947] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:29:09.758771 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b890c4fd-de4e-4a35-a4d6-6478dcabc1d4 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 204 len: 0 microversion: 2.1 time: 0.200333 Aug 31 00:29:09.760020 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 482/948] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:29:09 2022] DELETE /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:29:09.773501 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4a32c255-1e0a-4c1a-92cf-dfe5bc7efcac tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:09.774239 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4a32c255-1e0a-4c1a-92cf-dfe5bc7efcac tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:09.787799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a32c255-1e0a-4c1a-92cf-dfe5bc7efcac tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:09.788884 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a32c255-1e0a-4c1a-92cf-dfe5bc7efcac tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:09.789569 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a32c255-1e0a-4c1a-92cf-dfe5bc7efcac tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:09.791345 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a32c255-1e0a-4c1a-92cf-dfe5bc7efcac tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:09.793717 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a32c255-1e0a-4c1a-92cf-dfe5bc7efcac tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:09.794401 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4a32c255-1e0a-4c1a-92cf-dfe5bc7efcac tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:10.389140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-84e894fd-d8af-4305-8522-ef77a96c841e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:10.390576 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-84e894fd-d8af-4305-8522-ef77a96c841e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:10.417733 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84e894fd-d8af-4305-8522-ef77a96c841e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:10.418721 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84e894fd-d8af-4305-8522-ef77a96c841e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:10.420479 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84e894fd-d8af-4305-8522-ef77a96c841e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:10.426899 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84e894fd-d8af-4305-8522-ef77a96c841e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:10.427603 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84e894fd-d8af-4305-8522-ef77a96c841e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:10.428682 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-84e894fd-d8af-4305-8522-ef77a96c841e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:10.857746 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4a32c255-1e0a-4c1a-92cf-dfe5bc7efcac tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:10.869397 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4a32c255-1e0a-4c1a-92cf-dfe5bc7efcac tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 1.103939 Aug 31 00:29:10.873149 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 467/949] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:09 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:11.331305 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-84e894fd-d8af-4305-8522-ef77a96c841e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:11.361294 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-84e894fd-d8af-4305-8522-ef77a96c841e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1577 microversion: 2.1 time: 0.985991 Aug 31 00:29:11.364115 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 483/950] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:10 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1577 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:11.916013 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-553766c6-ccef-4b9b-9b8d-e0ba35d5e871 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:11.920111 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-553766c6-ccef-4b9b-9b8d-e0ba35d5e871 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:11.933099 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-553766c6-ccef-4b9b-9b8d-e0ba35d5e871 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:11.934419 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-553766c6-ccef-4b9b-9b8d-e0ba35d5e871 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:11.935769 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-553766c6-ccef-4b9b-9b8d-e0ba35d5e871 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:11.937340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-553766c6-ccef-4b9b-9b8d-e0ba35d5e871 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:11.938470 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-553766c6-ccef-4b9b-9b8d-e0ba35d5e871 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:11.939508 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-553766c6-ccef-4b9b-9b8d-e0ba35d5e871 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:12.399992 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-75f21551-f274-4b73-806c-e4dcca0e522f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:12.403792 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-75f21551-f274-4b73-806c-e4dcca0e522f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:12.418422 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75f21551-f274-4b73-806c-e4dcca0e522f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:12.419668 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75f21551-f274-4b73-806c-e4dcca0e522f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:12.421628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75f21551-f274-4b73-806c-e4dcca0e522f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:12.423739 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75f21551-f274-4b73-806c-e4dcca0e522f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:12.425117 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75f21551-f274-4b73-806c-e4dcca0e522f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:12.426115 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75f21551-f274-4b73-806c-e4dcca0e522f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:12.833100 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-75f21551-f274-4b73-806c-e4dcca0e522f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:12.860493 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-75f21551-f274-4b73-806c-e4dcca0e522f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1510 microversion: 2.1 time: 0.468098 Aug 31 00:29:12.896274 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 484/951] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:12 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1510 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:12.914390 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-abdbcd74-653d-44dd-9c6d-776f63ed9bf3 req-e13138da-1ef5-4324-bef3-f066965315ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95e1f70-6a63-40b2-a053-4b043f6b1ffa", "name": "network-vif-unplugged", "status": "completed", "tag": "c156e592-123d-470f-843d-661d21c8d777"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:12.945322 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-abdbcd74-653d-44dd-9c6d-776f63ed9bf3 req-e13138da-1ef5-4324-bef3-f066965315ea service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:12.946323 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-abdbcd74-653d-44dd-9c6d-776f63ed9bf3 req-e13138da-1ef5-4324-bef3-f066965315ea service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:12.948833 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-abdbcd74-653d-44dd-9c6d-776f63ed9bf3 req-e13138da-1ef5-4324-bef3-f066965315ea service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:12.977847 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-abdbcd74-653d-44dd-9c6d-776f63ed9bf3 req-e13138da-1ef5-4324-bef3-f066965315ea service nova] Creating event network-vif-unplugged:c156e592-123d-470f-843d-661d21c8d777 for instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa on hv-cinder-85221 Aug 31 00:29:13.001245 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-abdbcd74-653d-44dd-9c6d-776f63ed9bf3 req-e13138da-1ef5-4324-bef3-f066965315ea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101775 Aug 31 00:29:13.004429 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 485/952] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:13.111642 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-553766c6-ccef-4b9b-9b8d-e0ba35d5e871 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:13.145695 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-553766c6-ccef-4b9b-9b8d-e0ba35d5e871 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1566 microversion: 2.1 time: 1.234822 Aug 31 00:29:13.146853 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 468/953] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:11 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1566 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:13.910205 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f66745d1-c3df-45d5-b1f7-057d6851001e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:13.910924 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f66745d1-c3df-45d5-b1f7-057d6851001e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:13.928915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f66745d1-c3df-45d5-b1f7-057d6851001e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:13.928915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f66745d1-c3df-45d5-b1f7-057d6851001e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:13.928915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f66745d1-c3df-45d5-b1f7-057d6851001e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:13.928915 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f66745d1-c3df-45d5-b1f7-057d6851001e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:13.929521 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f66745d1-c3df-45d5-b1f7-057d6851001e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:13.930248 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f66745d1-c3df-45d5-b1f7-057d6851001e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:14.156672 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f66745d1-c3df-45d5-b1f7-057d6851001e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:14.177766 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f66745d1-c3df-45d5-b1f7-057d6851001e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1510 microversion: 2.1 time: 0.272578 Aug 31 00:29:14.178507 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 486/954] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:13 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1510 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:14.195094 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-cc3345f5-e41e-4e4c-a1fd-016fe3ed61f5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:14.196037 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-cc3345f5-e41e-4e4c-a1fd-016fe3ed61f5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:14.218833 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc3345f5-e41e-4e4c-a1fd-016fe3ed61f5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:14.219830 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc3345f5-e41e-4e4c-a1fd-016fe3ed61f5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:14.220937 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc3345f5-e41e-4e4c-a1fd-016fe3ed61f5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:14.222381 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc3345f5-e41e-4e4c-a1fd-016fe3ed61f5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:14.223282 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc3345f5-e41e-4e4c-a1fd-016fe3ed61f5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:14.224509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-cc3345f5-e41e-4e4c-a1fd-016fe3ed61f5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:14.257216 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-235a4acd-22fa-4902-a616-157e0c950d11 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:14.260131 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-235a4acd-22fa-4902-a616-157e0c950d11 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:14.277402 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-235a4acd-22fa-4902-a616-157e0c950d11 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:14.277892 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-235a4acd-22fa-4902-a616-157e0c950d11 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:14.278536 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-235a4acd-22fa-4902-a616-157e0c950d11 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:14.279460 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-235a4acd-22fa-4902-a616-157e0c950d11 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:14.280077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-235a4acd-22fa-4902-a616-157e0c950d11 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:14.280684 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-235a4acd-22fa-4902-a616-157e0c950d11 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:14.397709 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-235a4acd-22fa-4902-a616-157e0c950d11 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "POST /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/action" status: 202 len: 0 microversion: 2.1 time: 0.144363 Aug 31 00:29:14.398700 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 487/955] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:29:14 2022] POST /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:29:14.415883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-8db6bedb-ba96-47b3-aede-d2db801ebed5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:14.417315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-8db6bedb-ba96-47b3-aede-d2db801ebed5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:14.427041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8db6bedb-ba96-47b3-aede-d2db801ebed5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:14.428210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8db6bedb-ba96-47b3-aede-d2db801ebed5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:14.429128 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8db6bedb-ba96-47b3-aede-d2db801ebed5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:14.430872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8db6bedb-ba96-47b3-aede-d2db801ebed5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:14.431328 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8db6bedb-ba96-47b3-aede-d2db801ebed5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:14.431780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-8db6bedb-ba96-47b3-aede-d2db801ebed5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:14.530804 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-cc3345f5-e41e-4e4c-a1fd-016fe3ed61f5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:14.565868 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-cc3345f5-e41e-4e4c-a1fd-016fe3ed61f5 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1381 microversion: 2.1 time: 0.386839 Aug 31 00:29:14.567426 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 469/956] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:14 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1381 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:14.885224 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-20ad67c4-12ff-4c4b-a272-667d9a6723eb req-7656cbaf-1136-43b9-b2c8-6be1ed591af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95e1f70-6a63-40b2-a053-4b043f6b1ffa", "name": "network-vif-deleted", "tag": "c156e592-123d-470f-843d-661d21c8d777"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:14.946040 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-20ad67c4-12ff-4c4b-a272-667d9a6723eb req-7656cbaf-1136-43b9-b2c8-6be1ed591af7 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:14.947162 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-20ad67c4-12ff-4c4b-a272-667d9a6723eb req-7656cbaf-1136-43b9-b2c8-6be1ed591af7 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:14.952067 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-20ad67c4-12ff-4c4b-a272-667d9a6723eb req-7656cbaf-1136-43b9-b2c8-6be1ed591af7 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:15.035131 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-20ad67c4-12ff-4c4b-a272-667d9a6723eb req-7656cbaf-1136-43b9-b2c8-6be1ed591af7 service nova] Creating event network-vif-deleted:c156e592-123d-470f-843d-661d21c8d777 for instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa on hv-cinder-85221 Aug 31 00:29:15.071097 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-8db6bedb-ba96-47b3-aede-d2db801ebed5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:15.072646 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-20ad67c4-12ff-4c4b-a272-667d9a6723eb req-7656cbaf-1136-43b9-b2c8-6be1ed591af7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181525 Aug 31 00:29:15.074287 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 470/957] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:15.076222 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:15.125404 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-8db6bedb-ba96-47b3-aede-d2db801ebed5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1750 microversion: 2.1 time: 0.705884 Aug 31 00:29:15.133591 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 488/958] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:14 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1750 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:15.216742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8f71c3b9-8537-4396-8ece-b221525a8391 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:15.220435 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8f71c3b9-8537-4396-8ece-b221525a8391 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:15.242916 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8f71c3b9-8537-4396-8ece-b221525a8391 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:15.246652 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8f71c3b9-8537-4396-8ece-b221525a8391 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:15.247555 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8f71c3b9-8537-4396-8ece-b221525a8391 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:15.250329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8f71c3b9-8537-4396-8ece-b221525a8391 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:15.251183 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8f71c3b9-8537-4396-8ece-b221525a8391 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:15.253040 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8f71c3b9-8537-4396-8ece-b221525a8391 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:15.533238 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8f71c3b9-8537-4396-8ece-b221525a8391 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:15.551079 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8f71c3b9-8537-4396-8ece-b221525a8391 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1226 microversion: 2.1 time: 0.342963 Aug 31 00:29:15.567844 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 471/959] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:15 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1226 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:15.616458 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-241ee9e0-57a1-4c12-aa79-bba2522cbd80 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:15.618698 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-241ee9e0-57a1-4c12-aa79-bba2522cbd80 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:15.674985 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:15.687998 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241ee9e0-57a1-4c12-aa79-bba2522cbd80 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:15.695191 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241ee9e0-57a1-4c12-aa79-bba2522cbd80 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:15.697010 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241ee9e0-57a1-4c12-aa79-bba2522cbd80 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:15.700455 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241ee9e0-57a1-4c12-aa79-bba2522cbd80 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:15.705315 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241ee9e0-57a1-4c12-aa79-bba2522cbd80 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:15.714214 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-241ee9e0-57a1-4c12-aa79-bba2522cbd80 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:16.163179 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-241ee9e0-57a1-4c12-aa79-bba2522cbd80 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a798609294cb3ab6e0312ddbb1024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:16.176802 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6667c56c-2c16-49c0-95d7-7cac0dc30bd7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:16.177832 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6667c56c-2c16-49c0-95d7-7cac0dc30bd7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:16.197295 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-241ee9e0-57a1-4c12-aa79-bba2522cbd80 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 200 len: 1218 microversion: 2.1 time: 0.598062 Aug 31 00:29:16.199560 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6667c56c-2c16-49c0-95d7-7cac0dc30bd7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:16.200106 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6667c56c-2c16-49c0-95d7-7cac0dc30bd7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:16.200587 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6667c56c-2c16-49c0-95d7-7cac0dc30bd7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:16.201340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6667c56c-2c16-49c0-95d7-7cac0dc30bd7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:16.201807 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6667c56c-2c16-49c0-95d7-7cac0dc30bd7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:16.202266 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6667c56c-2c16-49c0-95d7-7cac0dc30bd7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:16.206556 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 489/960] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:15 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 1218 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:16.577031 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:16.578009 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:16.604615 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:16.607615 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:16.609790 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:16.613080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:16.617459 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:16.624483 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:16.705872 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6667c56c-2c16-49c0-95d7-7cac0dc30bd7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:16.730213 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6667c56c-2c16-49c0-95d7-7cac0dc30bd7 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1750 microversion: 2.1 time: 0.557512 Aug 31 00:29:16.745715 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 472/961] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:16 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1750 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:16.817140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:16.818217 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:16.819045 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:16.819861 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lazy-loading 'fault' on Instance uuid b3f5b45e-d0c7-461b-addb-c046c9cce995 {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:29:17.000400 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:17.021302 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-7189d00a-fa9d-4725-8775-21b127904f12 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 200 len: 1231 microversion: 2.1 time: 0.449646 Aug 31 00:29:17.023608 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 490/962] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:16 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 1231 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:17.110660 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-69b10785-49e9-4c50-8b33-1beefce158a1 req-76a61e51-aa7b-4cc4-ae6a-57a3b1d6cf2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f5b45e-d0c7-461b-addb-c046c9cce995", "name": "network-vif-deleted", "tag": "7ee0bda6-a8f6-49b1-b97f-b289c4493bf3"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:17.172484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-69b10785-49e9-4c50-8b33-1beefce158a1 req-76a61e51-aa7b-4cc4-ae6a-57a3b1d6cf2f service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:17.173345 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-69b10785-49e9-4c50-8b33-1beefce158a1 req-76a61e51-aa7b-4cc4-ae6a-57a3b1d6cf2f service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:17.174087 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-69b10785-49e9-4c50-8b33-1beefce158a1 req-76a61e51-aa7b-4cc4-ae6a-57a3b1d6cf2f service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:17.249664 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-69b10785-49e9-4c50-8b33-1beefce158a1 req-76a61e51-aa7b-4cc4-ae6a-57a3b1d6cf2f service nova] Creating event network-vif-deleted:7ee0bda6-a8f6-49b1-b97f-b289c4493bf3 for instance b3f5b45e-d0c7-461b-addb-c046c9cce995 on hv-cinder-85221 Aug 31 00:29:17.269143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:17.270339 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] [instance: c95e1f70-6a63-40b2-a053-4b043f6b1ffa] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:17.270843 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-69b10785-49e9-4c50-8b33-1beefce158a1 req-76a61e51-aa7b-4cc4-ae6a-57a3b1d6cf2f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165774 Aug 31 00:29:17.275742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 473/963] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:17.310347 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:17.311682 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:17.312419 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:17.313821 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:17.314695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:17.315296 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:17.340989 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] HTTP exception thrown: Instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa could not be found. Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Request method failure captured: Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa HTTP/1.1 Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqoGxaq-U_t_5uuZYOB7Z8txNc6MADVM4h0gNL6unl1yujQacFUPrjY98GT9J-n4s-wY87kMU13wTdK8VGY3BKd35UxnYFzDjoUqBMrYRkmGvsSqjsRWCGjjeu00K9i0xsd2mTr7fpprgRdEOoDrhklItXwZ6mZ50GdQYX8-ATEzUOU Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 81666ce8589a4e45ac7f5f9e6e6cc9a3 Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-TestShelveInstance-2083827755 Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:29:17.343628 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/81666ce8589a4e45ac7f5f9e6e6cc9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/81666ce8589a4e45ac7f5f9e6e6cc9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/81666ce8589a4e45ac7f5f9e6e6cc9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_81666ce8589a4e45ac7f5f9e6e6cc9a3"}]}] Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-TestShelveInstance-2083827755 Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 81666ce8589a4e45ac7f5f9e6e6cc9a3 Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-TestShelveInstance-2083827755 Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-TestShelveInstance-2083827755-project Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 213a798609294cb3ab6e0312ddbb1024 Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-TestShelveInstance-2083827755-project Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa could not be found. Aug 31 00:29:17.345364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'c95e1f70-6a63-40b2-a053-4b043f6b1ffa'} Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa could not be found. Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:17.346353 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa could not be found. Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa could not be found. Aug 31 00:29:17.347797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:17.354837 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Returning 404 to user: Instance c95e1f70-6a63-40b2-a053-4b043f6b1ffa could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:17.358906 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-75652b7e-587b-4c8e-9c4f-3bec343c4f96 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa" status: 404 len: 111 microversion: 2.1 time: 0.107892 Aug 31 00:29:17.366847 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 491/964] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:17 2022] GET /compute/v2.1/servers/c95e1f70-6a63-40b2-a053-4b043f6b1ffa => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:29:17.771687 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-0882fca8-aca3-4cd1-8da4-67258345295d tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:17.772864 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-0882fca8-aca3-4cd1-8da4-67258345295d tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:17.796689 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0882fca8-aca3-4cd1-8da4-67258345295d tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:17.799850 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0882fca8-aca3-4cd1-8da4-67258345295d tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:17.801108 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0882fca8-aca3-4cd1-8da4-67258345295d tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:17.804033 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0882fca8-aca3-4cd1-8da4-67258345295d tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:17.805165 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0882fca8-aca3-4cd1-8da4-67258345295d tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:17.806193 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-0882fca8-aca3-4cd1-8da4-67258345295d tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:18.059350 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-effc521f-89ce-45a5-b54c-a4741b4e2c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] Calling method '.version_select at 0x7f1a3a789b80>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:18.129797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-effc521f-89ce-45a5-b54c-a4741b4e2c22 tempest-TestShelveInstance-2083827755 tempest-TestShelveInstance-2083827755-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1834305697" status: 202 len: 0 microversion: 2.1 time: 0.064637 Aug 31 00:29:18.133042 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 492/965] 10.222.0.47 () {58 vars in 1254 bytes} [Wed Aug 31 00:29:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1834305697 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:29:18.175581 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:18.176637 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:18.199437 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:18.200684 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:18.202045 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:18.204139 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:18.205545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:18.206557 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:18.235817 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-0882fca8-aca3-4cd1-8da4-67258345295d tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:18.246577 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] HTTP exception thrown: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Request method failure captured: Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 HTTP/1.1 Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqqkQFZBYLl2xG06HpeUfGLO8TZSBJSmJtAD8uQEgMrD5qKnTY2EorKINya0G01pFRYAtnY4qR3o4XNja073Z-8TLcfkmho9FG5UJoeyeUNmOdF6z-1mtybAT_06IiS9JRhwdPie0RxQVcuQ1j1OB_jVtOvtwlGs_v_OIwDAaS9JM9o Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 5e59b45c75cb4f8ea7e7a47730709614 Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-TestVolumeBootPattern-239694876 Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:29:18.250545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5e59b45c75cb4f8ea7e7a47730709614"}]}] Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-TestVolumeBootPattern-239694876 Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 5e59b45c75cb4f8ea7e7a47730709614 Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-TestVolumeBootPattern-239694876 Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-TestVolumeBootPattern-239694876-project Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 410f2e9dc2db4ffcb5ff0f67b0d00ddc Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-TestVolumeBootPattern-239694876-project Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:29:18.253618 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'b3f5b45e-d0c7-461b-addb-c046c9cce995'} Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:18.255376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:29:18.258175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:18.272601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Returning 404 to user: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:18.273857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-0882fca8-aca3-4cd1-8da4-67258345295d tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1755 microversion: 2.1 time: 0.486552 Aug 31 00:29:18.273857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 474/966] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:17 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1755 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:18.288324 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-45e768ad-f4fa-4cf0-8b50-7abcb1d77ef2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 404 len: 111 microversion: 2.1 time: 0.137410 Aug 31 00:29:18.301852 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 493/967] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:18 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:29:18.533818 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1380285143", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1127305482", "security_groups": [{"name": "tempest-secgroup-smoke-835580744"}], "block_device_mapping_v2": [{"uuid": "3f5ea833-e8aa-4ad3-b067-b30ee8ca95e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2cf33b5d-0191-49b5-9f4e-a777ce59af25"}]}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:18.825882 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] validate_networks() for [('2cf33b5d-0191-49b5-9f4e-a777ce59af25', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:29:19.297366 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e59b177b-0ac3-4674-98e9-3f0b91c84628 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:19.308231 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e59b177b-0ac3-4674-98e9-3f0b91c84628 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:19.324444 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e59b177b-0ac3-4674-98e9-3f0b91c84628 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:19.325431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e59b177b-0ac3-4674-98e9-3f0b91c84628 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:19.326141 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e59b177b-0ac3-4674-98e9-3f0b91c84628 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:19.329197 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e59b177b-0ac3-4674-98e9-3f0b91c84628 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:19.330248 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e59b177b-0ac3-4674-98e9-3f0b91c84628 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:19.332302 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e59b177b-0ac3-4674-98e9-3f0b91c84628 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:19.629322 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:29:19.631221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:29:19.632839 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:29:19.633775 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:29:19.635039 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:29:19.672991 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:19.674479 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:19.677739 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:19.680139 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:19.680998 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:19.684686 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:19.729965 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Getting quotas for project 5e59b45c75cb4f8ea7e7a47730709614. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:29:19.738714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Getting quotas for user 410f2e9dc2db4ffcb5ff0f67b0d00ddc and project 5e59b45c75cb4f8ea7e7a47730709614. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:29:19.863256 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:29:19.865875 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f5ea833-e8aa-4ad3-b067-b30ee8ca95e9',volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:29:19.905346 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e59b177b-0ac3-4674-98e9-3f0b91c84628 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:19.914764 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e59b177b-0ac3-4674-98e9-3f0b91c84628 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1755 microversion: 2.1 time: 0.623320 Aug 31 00:29:19.924206 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 494/968] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:19 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1755 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:20.109919 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-71568128-de47-4486-b56a-843ad4642fea tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.584029 Aug 31 00:29:20.112213 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 475/969] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:29:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:29:20.128502 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0526697a-287e-44af-ace6-2737c5f6a673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:20.129134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0526697a-287e-44af-ace6-2737c5f6a673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:20.240635 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0526697a-287e-44af-ace6-2737c5f6a673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:20.249614 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0526697a-287e-44af-ace6-2737c5f6a673 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1095 microversion: 2.1 time: 0.125284 Aug 31 00:29:20.264074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 495/970] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:20 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1095 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:20.956566 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6ca737a1-c075-45df-9f9d-562e4a98a56a tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:20.964944 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6ca737a1-c075-45df-9f9d-562e4a98a56a tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:21.002563 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6ca737a1-c075-45df-9f9d-562e4a98a56a tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:21.003526 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6ca737a1-c075-45df-9f9d-562e4a98a56a tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:21.004651 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6ca737a1-c075-45df-9f9d-562e4a98a56a tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:21.009050 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6ca737a1-c075-45df-9f9d-562e4a98a56a tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:21.013519 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6ca737a1-c075-45df-9f9d-562e4a98a56a tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:21.017066 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6ca737a1-c075-45df-9f9d-562e4a98a56a tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:21.286935 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b18036f1-5d29-47ed-934f-2f131f7ed3a8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:21.288269 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b18036f1-5d29-47ed-934f-2f131f7ed3a8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:21.314160 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b18036f1-5d29-47ed-934f-2f131f7ed3a8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:21.317993 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b18036f1-5d29-47ed-934f-2f131f7ed3a8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:21.318593 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b18036f1-5d29-47ed-934f-2f131f7ed3a8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:21.319372 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b18036f1-5d29-47ed-934f-2f131f7ed3a8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:21.319858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b18036f1-5d29-47ed-934f-2f131f7ed3a8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:21.320382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b18036f1-5d29-47ed-934f-2f131f7ed3a8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:21.500997 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b18036f1-5d29-47ed-934f-2f131f7ed3a8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:21.518094 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b18036f1-5d29-47ed-934f-2f131f7ed3a8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1193 microversion: 2.1 time: 0.229652 Aug 31 00:29:21.518974 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 496/971] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:21 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1193 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:21.538063 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6ca737a1-c075-45df-9f9d-562e4a98a56a tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:21.541228 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:21.551175 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6ca737a1-c075-45df-9f9d-562e4a98a56a tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1755 microversion: 2.1 time: 0.603795 Aug 31 00:29:21.560671 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 476/972] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:20 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1755 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:22.547099 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0b6657e9-ec86-4967-b681-e174639aa767 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:22.548140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0b6657e9-ec86-4967-b681-e174639aa767 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:22.575248 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ede16ee9-9913-41f5-a01b-a8a6934d1ca4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:22.576341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ede16ee9-9913-41f5-a01b-a8a6934d1ca4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:22.583159 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0b6657e9-ec86-4967-b681-e174639aa767 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:22.584037 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0b6657e9-ec86-4967-b681-e174639aa767 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:22.589829 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0b6657e9-ec86-4967-b681-e174639aa767 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:22.590787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0b6657e9-ec86-4967-b681-e174639aa767 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:22.591582 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0b6657e9-ec86-4967-b681-e174639aa767 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:22.591808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0b6657e9-ec86-4967-b681-e174639aa767 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:22.625463 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ede16ee9-9913-41f5-a01b-a8a6934d1ca4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:22.627273 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ede16ee9-9913-41f5-a01b-a8a6934d1ca4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:22.629610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ede16ee9-9913-41f5-a01b-a8a6934d1ca4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:22.630635 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ede16ee9-9913-41f5-a01b-a8a6934d1ca4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:22.631323 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ede16ee9-9913-41f5-a01b-a8a6934d1ca4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:22.631592 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-ede16ee9-9913-41f5-a01b-a8a6934d1ca4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:22.965300 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-0b6657e9-ec86-4967-b681-e174639aa767 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:23.013521 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0b6657e9-ec86-4967-b681-e174639aa767 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1211 microversion: 2.1 time: 0.470010 Aug 31 00:29:23.024243 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 497/973] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:22 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1211 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:23.383064 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ede16ee9-9913-41f5-a01b-a8a6934d1ca4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:23.395189 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ede16ee9-9913-41f5-a01b-a8a6934d1ca4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1755 microversion: 2.1 time: 0.824847 Aug 31 00:29:23.395802 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 477/974] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:22 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1755 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:23.601325 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f5e38c79-c12c-4df7-94dc-f5699087fe4b tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Action: 'create', calling method: .version_select at 0x7f1a3a7894c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1070869131", "metadata": {"Type": "work"}}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f5e38c79-c12c-4df7-94dc-f5699087fe4b tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Request method failure captured: Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 122 Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqtjgy-UicCjljOMFmNun2qP6LpDn-IX7MMIFAfNtfoZ5k006zUJFkCCCt5WVRy5LxIk4Uz4Xi7tRj7OPS38OjltUM5493rSUkeIgg4XKQ4YfOk06VP-ChTbSeJB933DIR33V5lHg0yqNv2A4tcrSl41ZQHRk7L-4jFvStdU1HqXNXc Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:29:23.630855 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a082132d2c224d239d9a736073e604a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a082132d2c224d239d9a736073e604a2"}]}] Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 4e00bf6dda5f4ac6874892eb92cbf362 Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1070869131", "metadata": {"Type": "work"}}} Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: Aug 31 00:29:23.633685 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1070869131', 'metadata': {'Type': 'work'}}}} Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:23.635451 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:29:23.638326 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:29:23.643308 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:29:23.643308 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.644516 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f5e38c79-c12c-4df7-94dc-f5699087fe4b tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:23.646205 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f5e38c79-c12c-4df7-94dc-f5699087fe4b tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.263787 Aug 31 00:29:23.647306 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 498/975] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 31 00:29:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:29:23.659167 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-552d9af8-b159-4cd5-a9a2-23414a1d178e tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Action: 'create', calling method: .version_select at 0x7f1a3a8b41f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1842604595", "metadata": {"Type": "work"}}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-552d9af8-b159-4cd5-a9a2-23414a1d178e tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Request method failure captured: Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 120 Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqtjgy-UicCjljOMFmNun2qP6LpDn-IX7MMIFAfNtfoZ5k006zUJFkCCCt5WVRy5LxIk4Uz4Xi7tRj7OPS38OjltUM5493rSUkeIgg4XKQ4YfOk06VP-ChTbSeJB933DIR33V5lHg0yqNv2A4tcrSl41ZQHRk7L-4jFvStdU1HqXNXc Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:29:23.664655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a082132d2c224d239d9a736073e604a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a082132d2c224d239d9a736073e604a2"}]}] Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: 4e00bf6dda5f4ac6874892eb92cbf362 Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1842604595", "metadata": {"Type": "work"}}} Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: Aug 31 00:29:23.667284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1842604595', 'metadata': {'Type': 'work'}}}} Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi '0' Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:23.668583 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:29:23.670340 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:29:23.672901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:29:23.672901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.674821 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-552d9af8-b159-4cd5-a9a2-23414a1d178e tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:23.676514 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-552d9af8-b159-4cd5-a9a2-23414a1d178e tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021988 Aug 31 00:29:23.682954 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 478/976] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 31 00:29:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:29:23.699740 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-475a6a0f-fba6-4c0b-852f-378e7c31c723 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Action: 'create', calling method: .version_select at 0x7f1a3a7ead30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-546231586", "metadata": {"Type": "work"}}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-475a6a0f-fba6-4c0b-852f-378e7c31c723 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Request method failure captured: Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 118 Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqtjgy-UicCjljOMFmNun2qP6LpDn-IX7MMIFAfNtfoZ5k006zUJFkCCCt5WVRy5LxIk4Uz4Xi7tRj7OPS38OjltUM5493rSUkeIgg4XKQ4YfOk06VP-ChTbSeJB933DIR33V5lHg0yqNv2A4tcrSl41ZQHRk7L-4jFvStdU1HqXNXc Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:29:23.707982 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a082132d2c224d239d9a736073e604a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a082132d2c224d239d9a736073e604a2"}]}] Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 4e00bf6dda5f4ac6874892eb92cbf362 Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-546231586", "metadata": {"Type": "work"}}} Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: Aug 31 00:29:23.709755 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-546231586', 'metadata': {'Type': 'work'}}}} Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi '' Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:23.710768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:29:23.712846 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:29:23.717639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:29:23.717639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.717639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-475a6a0f-fba6-4c0b-852f-378e7c31c723 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:23.717639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-475a6a0f-fba6-4c0b-852f-378e7c31c723 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018635 Aug 31 00:29:23.717639 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 499/977] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 31 00:29:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:29:23.727622 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1c78b902-967e-4c07-8aef-5e9a37d174c4 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Calling method '.version_select at 0x7f1a3a9921f0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:23.770252 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-1c78b902-967e-4c07-8aef-5e9a37d174c4 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] HTTP exception thrown: Volume tempest-invalid-1506372218 could not be found. Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1c78b902-967e-4c07-8aef-5e9a37d174c4 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Request method failure captured: Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1506372218 HTTP/1.1 Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqtjgy-UicCjljOMFmNun2qP6LpDn-IX7MMIFAfNtfoZ5k006zUJFkCCCt5WVRy5LxIk4Uz4Xi7tRj7OPS38OjltUM5493rSUkeIgg4XKQ4YfOk06VP-ChTbSeJB933DIR33V5lHg0yqNv2A4tcrSl41ZQHRk7L-4jFvStdU1HqXNXc Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:29:23.773424 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a082132d2c224d239d9a736073e604a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a082132d2c224d239d9a736073e604a2"}]}] Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: 4e00bf6dda5f4ac6874892eb92cbf362 Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Volume tempest-invalid-1506372218 could not be found. Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': 'tempest-invalid-1506372218'} Aug 31 00:29:23.775155 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1506372218 could not be found. (HTTP 404) (Request-ID: req-fb5fbcc0-2e31-40dc-8cc1-7a05516c1621) Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.777125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:29:23.778946 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1506372218 could not be found. Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:23.780883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1506372218 could not be found. Aug 31 00:29:23.783180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.783180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.783180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.783180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.783180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:23.783180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:23.783180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:23.783180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:23.783180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1506372218 could not be found. Aug 31 00:29:23.783180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.786139 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1c78b902-967e-4c07-8aef-5e9a37d174c4 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Returning 404 to user: Volume tempest-invalid-1506372218 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:23.786139 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1c78b902-967e-4c07-8aef-5e9a37d174c4 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1506372218" status: 404 len: 99 microversion: 2.1 time: 0.065269 Aug 31 00:29:23.786694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 479/978] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Aug 31 00:29:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1506372218 => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 00:29:23.801980 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b0bfc831-0b66-4d10-aa81-6a40d840c620 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007223 Aug 31 00:29:23.803442 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 500/979] 10.222.0.47 () {58 vars in 1140 bytes} [Wed Aug 31 00:29:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 00:29:23.817747 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a40d0d35-5b18-4960-9a1a-0f0c4dfcc7d5 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006854 Aug 31 00:29:23.831711 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-79c42bfa-fc9b-4494-9f48-b3718f9dd384 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Calling method '.version_select at 0x7f1a3a7f7670>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:23.836200 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 480/980] 10.222.0.47 () {58 vars in 1137 bytes} [Wed Aug 31 00:29:23 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 31 00:29:23.903942 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-79c42bfa-fc9b-4494-9f48-b3718f9dd384 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] HTTP exception thrown: Volume 98a71ce9-bc96-4393-9824-1a112d544614 could not be found. Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-79c42bfa-fc9b-4494-9f48-b3718f9dd384 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Request method failure captured: Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: DELETE /compute/v2.1/os-volumes/98a71ce9-bc96-4393-9824-1a112d544614 HTTP/1.1 Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqtjgy-UicCjljOMFmNun2qP6LpDn-IX7MMIFAfNtfoZ5k006zUJFkCCCt5WVRy5LxIk4Uz4Xi7tRj7OPS38OjltUM5493rSUkeIgg4XKQ4YfOk06VP-ChTbSeJB933DIR33V5lHg0yqNv2A4tcrSl41ZQHRk7L-4jFvStdU1HqXNXc Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:29:23.908220 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a082132d2c224d239d9a736073e604a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a082132d2c224d239d9a736073e604a2"}]}] Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 4e00bf6dda5f4ac6874892eb92cbf362 Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Volume 98a71ce9-bc96-4393-9824-1a112d544614 could not be found. Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': '98a71ce9-bc96-4393-9824-1a112d544614'} Aug 31 00:29:23.909714 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98a71ce9-bc96-4393-9824-1a112d544614 could not be found. (HTTP 404) (Request-ID: req-37591d87-0c2b-4bea-a339-261129cea588) Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.910783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:29:23.912055 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98a71ce9-bc96-4393-9824-1a112d544614 could not be found. Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 00:29:23.913375 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98a71ce9-bc96-4393-9824-1a112d544614 could not be found. Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98a71ce9-bc96-4393-9824-1a112d544614 could not be found. Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-79c42bfa-fc9b-4494-9f48-b3718f9dd384 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Returning 404 to user: Volume 98a71ce9-bc96-4393-9824-1a112d544614 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:23.915907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-79c42bfa-fc9b-4494-9f48-b3718f9dd384 tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/98a71ce9-bc96-4393-9824-1a112d544614" status: 404 len: 109 microversion: 2.1 time: 0.084961 Aug 31 00:29:23.934264 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-649260ae-7189-4ad3-b08d-12657ff9edfe tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Calling method '.version_select at 0x7f1a3a8b4ee0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:23.938236 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 501/981] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 31 00:29:23 2022] DELETE /compute/v2.1/os-volumes/98a71ce9-bc96-4393-9824-1a112d544614 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:29:24.066452 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-649260ae-7189-4ad3-b08d-12657ff9edfe tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] HTTP exception thrown: Volume 4fe21723-e70a-4527-9458-906acdcbf14c could not be found. Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-649260ae-7189-4ad3-b08d-12657ff9edfe tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Request method failure captured: Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: GET /compute/v2.1/os-volumes/4fe21723-e70a-4527-9458-906acdcbf14c HTTP/1.1 Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqtjgy-UicCjljOMFmNun2qP6LpDn-IX7MMIFAfNtfoZ5k006zUJFkCCCt5WVRy5LxIk4Uz4Xi7tRj7OPS38OjltUM5493rSUkeIgg4XKQ4YfOk06VP-ChTbSeJB933DIR33V5lHg0yqNv2A4tcrSl41ZQHRk7L-4jFvStdU1HqXNXc Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:29:24.068982 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a082132d2c224d239d9a736073e604a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a082132d2c224d239d9a736073e604a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a082132d2c224d239d9a736073e604a2"}]}] Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: a082132d2c224d239d9a736073e604a2 Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-VolumesNegativeTest-207311695 Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: 4e00bf6dda5f4ac6874892eb92cbf362 Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-VolumesNegativeTest-207311695-project Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Volume 4fe21723-e70a-4527-9458-906acdcbf14c could not be found. Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': '4fe21723-e70a-4527-9458-906acdcbf14c'} Aug 31 00:29:24.070421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4fe21723-e70a-4527-9458-906acdcbf14c could not be found. (HTTP 404) (Request-ID: req-61212ecb-705e-4f0d-a10d-570d51fd122a) Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:24.072289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:29:24.073900 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4fe21723-e70a-4527-9458-906acdcbf14c could not be found. Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:29:24.077326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4fe21723-e70a-4527-9458-906acdcbf14c could not be found. Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4fe21723-e70a-4527-9458-906acdcbf14c could not be found. Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-649260ae-7189-4ad3-b08d-12657ff9edfe tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] Returning 404 to user: Volume 4fe21723-e70a-4527-9458-906acdcbf14c could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-649260ae-7189-4ad3-b08d-12657ff9edfe tempest-VolumesNegativeTest-207311695 tempest-VolumesNegativeTest-207311695-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4fe21723-e70a-4527-9458-906acdcbf14c" status: 404 len: 109 microversion: 2.1 time: 0.145002 Aug 31 00:29:24.080489 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 481/982] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 31 00:29:23 2022] GET /compute/v2.1/os-volumes/4fe21723-e70a-4527-9458-906acdcbf14c => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:29:24.087140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-bf422d41-58ee-4289-8d58-3d4200dde616 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:24.097385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-bf422d41-58ee-4289-8d58-3d4200dde616 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:24.146286 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf422d41-58ee-4289-8d58-3d4200dde616 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:24.147613 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf422d41-58ee-4289-8d58-3d4200dde616 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:24.148578 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf422d41-58ee-4289-8d58-3d4200dde616 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:24.154035 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf422d41-58ee-4289-8d58-3d4200dde616 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:24.155223 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf422d41-58ee-4289-8d58-3d4200dde616 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:24.157083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-bf422d41-58ee-4289-8d58-3d4200dde616 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:24.426628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-077f40c8-f635-46a8-bc9c-3a828661e0e9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:24.427266 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-077f40c8-f635-46a8-bc9c-3a828661e0e9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:24.439625 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-077f40c8-f635-46a8-bc9c-3a828661e0e9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:24.443222 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-077f40c8-f635-46a8-bc9c-3a828661e0e9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:24.449397 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-077f40c8-f635-46a8-bc9c-3a828661e0e9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:24.450456 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-077f40c8-f635-46a8-bc9c-3a828661e0e9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:24.455271 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-077f40c8-f635-46a8-bc9c-3a828661e0e9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:24.456119 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-077f40c8-f635-46a8-bc9c-3a828661e0e9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:24.860970 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-bf422d41-58ee-4289-8d58-3d4200dde616 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:24.887360 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-bf422d41-58ee-4289-8d58-3d4200dde616 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1278 microversion: 2.1 time: 0.828825 Aug 31 00:29:24.903651 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 502/983] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:24 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1278 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:25.250880 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-077f40c8-f635-46a8-bc9c-3a828661e0e9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:25.301791 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-077f40c8-f635-46a8-bc9c-3a828661e0e9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1755 microversion: 2.1 time: 0.881045 Aug 31 00:29:25.303050 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 482/984] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:24 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1755 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:25.934246 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f601c7f2-2c1b-4c48-813c-e6bf579af212 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:25.934246 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f601c7f2-2c1b-4c48-813c-e6bf579af212 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:25.942520 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f601c7f2-2c1b-4c48-813c-e6bf579af212 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:25.943029 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f601c7f2-2c1b-4c48-813c-e6bf579af212 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:25.943610 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f601c7f2-2c1b-4c48-813c-e6bf579af212 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:25.949283 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f601c7f2-2c1b-4c48-813c-e6bf579af212 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:25.953305 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f601c7f2-2c1b-4c48-813c-e6bf579af212 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:25.961530 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f601c7f2-2c1b-4c48-813c-e6bf579af212 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:26.111308 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-b8388fa3-cba9-49da-bff0-47db55ef4b59 req-37825ce1-f735-4448-961a-efd4ed46b2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b1b4a7-4601-4c6f-b667-25a15b25d482", "tag": "9a806204-d2a5-4045-9aff-43a374bd4e1e"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:26.133284 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-b8388fa3-cba9-49da-bff0-47db55ef4b59 req-37825ce1-f735-4448-961a-efd4ed46b2a2 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:26.133723 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-b8388fa3-cba9-49da-bff0-47db55ef4b59 req-37825ce1-f735-4448-961a-efd4ed46b2a2 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:26.136098 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-b8388fa3-cba9-49da-bff0-47db55ef4b59 req-37825ce1-f735-4448-961a-efd4ed46b2a2 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:26.178675 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-b8388fa3-cba9-49da-bff0-47db55ef4b59 req-37825ce1-f735-4448-961a-efd4ed46b2a2 service nova] Creating event network-changed:9a806204-d2a5-4045-9aff-43a374bd4e1e for instance c3b1b4a7-4601-4c6f-b667-25a15b25d482 on hv-cinder-85221 Aug 31 00:29:26.186738 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-b8388fa3-cba9-49da-bff0-47db55ef4b59 req-37825ce1-f735-4448-961a-efd4ed46b2a2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084769 Aug 31 00:29:26.188377 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 483/985] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:29:26.330477 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c18e0692-8f07-4ff5-aa86-31901b780afe tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:26.332235 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c18e0692-8f07-4ff5-aa86-31901b780afe tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:26.354585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c18e0692-8f07-4ff5-aa86-31901b780afe tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:26.355570 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c18e0692-8f07-4ff5-aa86-31901b780afe tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:26.357309 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c18e0692-8f07-4ff5-aa86-31901b780afe tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:26.358073 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c18e0692-8f07-4ff5-aa86-31901b780afe tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:26.362962 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c18e0692-8f07-4ff5-aa86-31901b780afe tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:26.363692 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c18e0692-8f07-4ff5-aa86-31901b780afe tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:26.580556 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f601c7f2-2c1b-4c48-813c-e6bf579af212 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:26.595635 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f601c7f2-2c1b-4c48-813c-e6bf579af212 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.674521 Aug 31 00:29:26.597581 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 503/986] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:25 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:27.109410 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c18e0692-8f07-4ff5-aa86-31901b780afe tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:27.151842 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c18e0692-8f07-4ff5-aa86-31901b780afe tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1755 microversion: 2.1 time: 0.827263 Aug 31 00:29:27.167880 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 484/987] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:26 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1755 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:27.641119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a1d9456b-654a-4d00-b65d-86e113320fdc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:27.642530 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a1d9456b-654a-4d00-b65d-86e113320fdc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:27.666895 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a1d9456b-654a-4d00-b65d-86e113320fdc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:27.668380 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a1d9456b-654a-4d00-b65d-86e113320fdc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:27.669049 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a1d9456b-654a-4d00-b65d-86e113320fdc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:27.670008 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a1d9456b-654a-4d00-b65d-86e113320fdc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:27.670663 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a1d9456b-654a-4d00-b65d-86e113320fdc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:27.671271 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a1d9456b-654a-4d00-b65d-86e113320fdc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:27.961546 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a1d9456b-654a-4d00-b65d-86e113320fdc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:27.971412 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a1d9456b-654a-4d00-b65d-86e113320fdc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.334392 Aug 31 00:29:27.972819 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 504/988] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:27 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:28.194022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-419b4471-b62d-4f92-863a-cf0909cfb552 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:28.195323 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-419b4471-b62d-4f92-863a-cf0909cfb552 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:28.208272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-419b4471-b62d-4f92-863a-cf0909cfb552 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:28.210090 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-419b4471-b62d-4f92-863a-cf0909cfb552 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:28.211168 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-419b4471-b62d-4f92-863a-cf0909cfb552 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:28.215459 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-419b4471-b62d-4f92-863a-cf0909cfb552 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:28.216780 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-419b4471-b62d-4f92-863a-cf0909cfb552 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:28.217532 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-419b4471-b62d-4f92-863a-cf0909cfb552 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:28.529714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-419b4471-b62d-4f92-863a-cf0909cfb552 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:28.555723 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-419b4471-b62d-4f92-863a-cf0909cfb552 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1755 microversion: 2.1 time: 0.365852 Aug 31 00:29:28.556791 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 485/989] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:28 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1755 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:29.012112 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-e0e3e994-e45d-4419-877a-5ef1383cb236 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:29.017059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-e0e3e994-e45d-4419-877a-5ef1383cb236 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:29.049278 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0e3e994-e45d-4419-877a-5ef1383cb236 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:29.051933 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0e3e994-e45d-4419-877a-5ef1383cb236 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:29.052777 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0e3e994-e45d-4419-877a-5ef1383cb236 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:29.054289 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0e3e994-e45d-4419-877a-5ef1383cb236 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:29.055149 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0e3e994-e45d-4419-877a-5ef1383cb236 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:29.069921 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-e0e3e994-e45d-4419-877a-5ef1383cb236 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:29.510599 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-e0e3e994-e45d-4419-877a-5ef1383cb236 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:29.546829 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-e0e3e994-e45d-4419-877a-5ef1383cb236 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.552195 Aug 31 00:29:29.548922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 505/990] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:28 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:29.593921 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-7efa8a5b-0e0e-42fd-9858-839e07c7b3f9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:29.595318 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-7efa8a5b-0e0e-42fd-9858-839e07c7b3f9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:29.610081 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7efa8a5b-0e0e-42fd-9858-839e07c7b3f9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:29.613096 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7efa8a5b-0e0e-42fd-9858-839e07c7b3f9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:29.613556 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7efa8a5b-0e0e-42fd-9858-839e07c7b3f9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:29.615743 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7efa8a5b-0e0e-42fd-9858-839e07c7b3f9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:29.616266 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7efa8a5b-0e0e-42fd-9858-839e07c7b3f9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:29.617963 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-7efa8a5b-0e0e-42fd-9858-839e07c7b3f9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:29.716295 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:29.751677 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=6 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:30.029484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-7efa8a5b-0e0e-42fd-9858-839e07c7b3f9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:30.055801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-7efa8a5b-0e0e-42fd-9858-839e07c7b3f9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1758 microversion: 2.1 time: 0.465688 Aug 31 00:29:30.058293 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 486/991] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:29 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1758 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:30.570321 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d7374b29-f628-46cd-83f7-ba7b912ac8e8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:30.572113 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d7374b29-f628-46cd-83f7-ba7b912ac8e8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:30.575616 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:30.582507 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d7374b29-f628-46cd-83f7-ba7b912ac8e8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:30.583406 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d7374b29-f628-46cd-83f7-ba7b912ac8e8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:30.584031 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d7374b29-f628-46cd-83f7-ba7b912ac8e8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:30.585047 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d7374b29-f628-46cd-83f7-ba7b912ac8e8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:30.585743 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d7374b29-f628-46cd-83f7-ba7b912ac8e8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:30.586510 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d7374b29-f628-46cd-83f7-ba7b912ac8e8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:30.794124 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d7374b29-f628-46cd-83f7-ba7b912ac8e8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:30.804599 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d7374b29-f628-46cd-83f7-ba7b912ac8e8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.239229 Aug 31 00:29:30.818146 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 506/992] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:30 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:31.841338 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-43488de9-ac3b-485c-bb59-5147f7fdbc5b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:31.847518 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-43488de9-ac3b-485c-bb59-5147f7fdbc5b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:31.890337 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43488de9-ac3b-485c-bb59-5147f7fdbc5b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:31.891996 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43488de9-ac3b-485c-bb59-5147f7fdbc5b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:31.894387 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43488de9-ac3b-485c-bb59-5147f7fdbc5b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:31.898999 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43488de9-ac3b-485c-bb59-5147f7fdbc5b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:31.902282 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43488de9-ac3b-485c-bb59-5147f7fdbc5b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:31.912569 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-43488de9-ac3b-485c-bb59-5147f7fdbc5b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:32.288738 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-43488de9-ac3b-485c-bb59-5147f7fdbc5b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:32.323530 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-43488de9-ac3b-485c-bb59-5147f7fdbc5b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.493370 Aug 31 00:29:32.340243 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 487/993] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:31 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:33.367523 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-637a8706-e915-4890-8c5c-3f5697ca508f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:33.369976 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-637a8706-e915-4890-8c5c-3f5697ca508f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:33.379547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-637a8706-e915-4890-8c5c-3f5697ca508f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:33.381233 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-637a8706-e915-4890-8c5c-3f5697ca508f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:33.382412 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-637a8706-e915-4890-8c5c-3f5697ca508f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:33.383503 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-637a8706-e915-4890-8c5c-3f5697ca508f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:33.384278 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-637a8706-e915-4890-8c5c-3f5697ca508f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:33.385140 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-637a8706-e915-4890-8c5c-3f5697ca508f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:33.717954 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-637a8706-e915-4890-8c5c-3f5697ca508f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:33.752256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-637a8706-e915-4890-8c5c-3f5697ca508f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.387402 Aug 31 00:29:33.755522 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 507/994] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:33 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:34.783485 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4024c726-91a8-4c08-aee0-dccb0c915b0e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:34.784512 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4024c726-91a8-4c08-aee0-dccb0c915b0e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:34.792747 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4024c726-91a8-4c08-aee0-dccb0c915b0e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:34.793548 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4024c726-91a8-4c08-aee0-dccb0c915b0e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:34.794512 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4024c726-91a8-4c08-aee0-dccb0c915b0e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:34.795990 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4024c726-91a8-4c08-aee0-dccb0c915b0e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:34.796845 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4024c726-91a8-4c08-aee0-dccb0c915b0e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:34.797893 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4024c726-91a8-4c08-aee0-dccb0c915b0e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:35.054431 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4024c726-91a8-4c08-aee0-dccb0c915b0e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:35.071678 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4024c726-91a8-4c08-aee0-dccb0c915b0e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.292932 Aug 31 00:29:35.075807 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 488/995] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:34 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:36.113136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-61b368e1-b4a0-4bde-876a-911749a7907e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:36.114273 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-61b368e1-b4a0-4bde-876a-911749a7907e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:36.131765 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61b368e1-b4a0-4bde-876a-911749a7907e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:36.132727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61b368e1-b4a0-4bde-876a-911749a7907e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:36.134801 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61b368e1-b4a0-4bde-876a-911749a7907e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:36.136530 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61b368e1-b4a0-4bde-876a-911749a7907e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:36.137631 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61b368e1-b4a0-4bde-876a-911749a7907e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:36.138583 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-61b368e1-b4a0-4bde-876a-911749a7907e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:36.376753 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-61b368e1-b4a0-4bde-876a-911749a7907e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:36.390126 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-61b368e1-b4a0-4bde-876a-911749a7907e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.281982 Aug 31 00:29:36.390999 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 508/996] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:36 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:37.426596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-20faf455-790e-45b8-b22b-f39cc3321448 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:37.427610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-20faf455-790e-45b8-b22b-f39cc3321448 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:37.436464 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20faf455-790e-45b8-b22b-f39cc3321448 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:37.437262 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20faf455-790e-45b8-b22b-f39cc3321448 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:37.439011 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20faf455-790e-45b8-b22b-f39cc3321448 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:37.439591 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20faf455-790e-45b8-b22b-f39cc3321448 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:37.440412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20faf455-790e-45b8-b22b-f39cc3321448 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:37.441185 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-20faf455-790e-45b8-b22b-f39cc3321448 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:37.668308 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-20faf455-790e-45b8-b22b-f39cc3321448 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:37.684052 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-20faf455-790e-45b8-b22b-f39cc3321448 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.261760 Aug 31 00:29:37.684886 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 489/997] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:37 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:38.718040 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-498b73ad-e585-45de-ae19-b3308e03963a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:38.718620 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-498b73ad-e585-45de-ae19-b3308e03963a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:38.725877 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-498b73ad-e585-45de-ae19-b3308e03963a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:38.726365 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-498b73ad-e585-45de-ae19-b3308e03963a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:38.726799 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-498b73ad-e585-45de-ae19-b3308e03963a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:38.727514 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-498b73ad-e585-45de-ae19-b3308e03963a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:38.727966 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-498b73ad-e585-45de-ae19-b3308e03963a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:38.728421 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-498b73ad-e585-45de-ae19-b3308e03963a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:38.907671 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-498b73ad-e585-45de-ae19-b3308e03963a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:38.922283 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-498b73ad-e585-45de-ae19-b3308e03963a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.209318 Aug 31 00:29:38.923772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 509/998] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:38 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:39.959126 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-aaa0b8cb-b276-4f0d-bd3a-abf85d235ad8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:39.959993 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-aaa0b8cb-b276-4f0d-bd3a-abf85d235ad8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:39.964116 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:39.968453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aaa0b8cb-b276-4f0d-bd3a-abf85d235ad8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:39.969591 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aaa0b8cb-b276-4f0d-bd3a-abf85d235ad8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:39.970042 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aaa0b8cb-b276-4f0d-bd3a-abf85d235ad8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:39.970778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aaa0b8cb-b276-4f0d-bd3a-abf85d235ad8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:39.971232 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aaa0b8cb-b276-4f0d-bd3a-abf85d235ad8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:39.971809 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aaa0b8cb-b276-4f0d-bd3a-abf85d235ad8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:40.034063 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-97dc2701-28f9-47e8-adac-37ea64917737 req-26d65339-d8f5-4286-a2f6-0de1fb829183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b1b4a7-4601-4c6f-b667-25a15b25d482", "name": "network-vif-plugged", "status": "completed", "tag": "9a806204-d2a5-4045-9aff-43a374bd4e1e"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:40.059162 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-97dc2701-28f9-47e8-adac-37ea64917737 req-26d65339-d8f5-4286-a2f6-0de1fb829183 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:40.060781 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-97dc2701-28f9-47e8-adac-37ea64917737 req-26d65339-d8f5-4286-a2f6-0de1fb829183 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:40.061834 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-97dc2701-28f9-47e8-adac-37ea64917737 req-26d65339-d8f5-4286-a2f6-0de1fb829183 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:40.084833 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-97dc2701-28f9-47e8-adac-37ea64917737 req-26d65339-d8f5-4286-a2f6-0de1fb829183 service nova] Creating event network-vif-plugged:9a806204-d2a5-4045-9aff-43a374bd4e1e for instance c3b1b4a7-4601-4c6f-b667-25a15b25d482 on hv-cinder-85221 Aug 31 00:29:40.095185 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-97dc2701-28f9-47e8-adac-37ea64917737 req-26d65339-d8f5-4286-a2f6-0de1fb829183 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071713 Aug 31 00:29:40.096348 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 510/999] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:29:40.210037 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-aaa0b8cb-b276-4f0d-bd3a-abf85d235ad8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:40.221781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-aaa0b8cb-b276-4f0d-bd3a-abf85d235ad8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.266744 Aug 31 00:29:40.222609 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 490/1000] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:39 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:41.277490 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-9ba4dbad-6f4f-4c5d-903b-f21aecdd79a1 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:41.279095 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-9ba4dbad-6f4f-4c5d-903b-f21aecdd79a1 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:41.300765 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbad-6f4f-4c5d-903b-f21aecdd79a1 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:41.303725 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbad-6f4f-4c5d-903b-f21aecdd79a1 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:41.305344 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbad-6f4f-4c5d-903b-f21aecdd79a1 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:41.306278 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbad-6f4f-4c5d-903b-f21aecdd79a1 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:41.306972 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbad-6f4f-4c5d-903b-f21aecdd79a1 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:41.308116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbad-6f4f-4c5d-903b-f21aecdd79a1 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:41.576311 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-9ba4dbad-6f4f-4c5d-903b-f21aecdd79a1 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:41.598887 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-9ba4dbad-6f4f-4c5d-903b-f21aecdd79a1 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1266 microversion: 2.1 time: 0.354666 Aug 31 00:29:41.600716 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 511/1001] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:41 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:42.639238 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e77867cf-0eed-4cc4-84fa-6ce258e3551d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:42.640488 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e77867cf-0eed-4cc4-84fa-6ce258e3551d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:42.657679 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e77867cf-0eed-4cc4-84fa-6ce258e3551d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:42.658894 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e77867cf-0eed-4cc4-84fa-6ce258e3551d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:42.659664 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e77867cf-0eed-4cc4-84fa-6ce258e3551d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:42.661118 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e77867cf-0eed-4cc4-84fa-6ce258e3551d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:42.662019 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e77867cf-0eed-4cc4-84fa-6ce258e3551d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:42.663206 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e77867cf-0eed-4cc4-84fa-6ce258e3551d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:42.886872 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e77867cf-0eed-4cc4-84fa-6ce258e3551d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:42.895331 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e77867cf-0eed-4cc4-84fa-6ce258e3551d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1454 microversion: 2.1 time: 0.266765 Aug 31 00:29:42.895941 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 491/1002] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:42 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1454 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:42.918548 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-66869db4-a80b-488c-a0a6-7d7b53c50dbc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:42.919566 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-66869db4-a80b-488c-a0a6-7d7b53c50dbc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:42.927041 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66869db4-a80b-488c-a0a6-7d7b53c50dbc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:42.927537 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66869db4-a80b-488c-a0a6-7d7b53c50dbc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:42.927991 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66869db4-a80b-488c-a0a6-7d7b53c50dbc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:42.928742 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66869db4-a80b-488c-a0a6-7d7b53c50dbc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:42.929202 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66869db4-a80b-488c-a0a6-7d7b53c50dbc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:42.929637 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-66869db4-a80b-488c-a0a6-7d7b53c50dbc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:43.087352 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-66869db4-a80b-488c-a0a6-7d7b53c50dbc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:43.096081 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-66869db4-a80b-488c-a0a6-7d7b53c50dbc tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1454 microversion: 2.1 time: 0.182429 Aug 31 00:29:43.096772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 512/1003] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:42 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:45.470534 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-344734a5-cc97-429b-985d-275cd336e969 req-736b4c95-b0fb-4a0c-92a6-4bccce204faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b1b4a7-4601-4c6f-b667-25a15b25d482", "tag": "9a806204-d2a5-4045-9aff-43a374bd4e1e"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:45.485957 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-344734a5-cc97-429b-985d-275cd336e969 req-736b4c95-b0fb-4a0c-92a6-4bccce204faf service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:45.486768 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-344734a5-cc97-429b-985d-275cd336e969 req-736b4c95-b0fb-4a0c-92a6-4bccce204faf service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:45.487496 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-344734a5-cc97-429b-985d-275cd336e969 req-736b4c95-b0fb-4a0c-92a6-4bccce204faf service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:45.501384 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-344734a5-cc97-429b-985d-275cd336e969 req-736b4c95-b0fb-4a0c-92a6-4bccce204faf service nova] Creating event network-changed:9a806204-d2a5-4045-9aff-43a374bd4e1e for instance c3b1b4a7-4601-4c6f-b667-25a15b25d482 on hv-cinder-85221 Aug 31 00:29:45.507322 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-344734a5-cc97-429b-985d-275cd336e969 req-736b4c95-b0fb-4a0c-92a6-4bccce204faf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040497 Aug 31 00:29:45.508056 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 492/1004] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:30:06.153314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-556f5044-16f5-42d7-8a6c-e82428fc0c03 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1821979224"}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:06.155107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-556f5044-16f5-42d7-8a6c-e82428fc0c03 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:06.163841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:06.165060 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=99 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:06.167906 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-556f5044-16f5-42d7-8a6c-e82428fc0c03 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:06.168743 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-556f5044-16f5-42d7-8a6c-e82428fc0c03 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:06.169481 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-556f5044-16f5-42d7-8a6c-e82428fc0c03 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:06.170480 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-556f5044-16f5-42d7-8a6c-e82428fc0c03 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:06.171162 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-556f5044-16f5-42d7-8a6c-e82428fc0c03 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:06.171811 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-556f5044-16f5-42d7-8a6c-e82428fc0c03 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:06.354648 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.network.security_group_api [None req-556f5044-16f5-42d7-8a6c-e82428fc0c03 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Removing security group e9405b4c-01ab-49c0-90c5-9e0a220dfb7a from port 05830bf8-556a-469a-9d00-f97cadfd56ba Aug 31 00:30:06.857538 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-556f5044-16f5-42d7-8a6c-e82428fc0c03 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "POST /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/action" status: 202 len: 0 microversion: 2.1 time: 0.711661 Aug 31 00:30:06.858244 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 513/1005] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 31 00:30:06 2022] POST /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:30:06.910752 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-d24cf4a5-2a50-4c82-bf27-6aeed1e4a63f req-a4c07952-b28d-4c47-9acd-5f145834e7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e", "tag": "05830bf8-556a-469a-9d00-f97cadfd56ba"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:06.930329 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=5 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:06.933901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=65 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:06.940871 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d24cf4a5-2a50-4c82-bf27-6aeed1e4a63f req-a4c07952-b28d-4c47-9acd-5f145834e7d6 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:06.942743 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d24cf4a5-2a50-4c82-bf27-6aeed1e4a63f req-a4c07952-b28d-4c47-9acd-5f145834e7d6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:06.944628 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d24cf4a5-2a50-4c82-bf27-6aeed1e4a63f req-a4c07952-b28d-4c47-9acd-5f145834e7d6 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:06.971413 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-d24cf4a5-2a50-4c82-bf27-6aeed1e4a63f req-a4c07952-b28d-4c47-9acd-5f145834e7d6 service nova] Creating event network-changed:05830bf8-556a-469a-9d00-f97cadfd56ba for instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e on hv-cinder-85221 Aug 31 00:30:06.984287 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-d24cf4a5-2a50-4c82-bf27-6aeed1e4a63f req-a4c07952-b28d-4c47-9acd-5f145834e7d6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080081 Aug 31 00:30:06.985771 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 493/1006] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:30:08.515719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-80f114a9-c8be-4cad-b8f8-6dc355438bb5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:08.516424 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-80f114a9-c8be-4cad-b8f8-6dc355438bb5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:08.525708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80f114a9-c8be-4cad-b8f8-6dc355438bb5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:08.527661 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80f114a9-c8be-4cad-b8f8-6dc355438bb5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:08.528389 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80f114a9-c8be-4cad-b8f8-6dc355438bb5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:08.529486 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-9c6f533c-99e8-4e04-b3d4-d6c11c67c862 req-be964472-5c87-4710-a678-48618a3ee40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e", "tag": "05830bf8-556a-469a-9d00-f97cadfd56ba"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:08.533252 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80f114a9-c8be-4cad-b8f8-6dc355438bb5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:08.534089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80f114a9-c8be-4cad-b8f8-6dc355438bb5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:08.534718 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-80f114a9-c8be-4cad-b8f8-6dc355438bb5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:08.543042 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-9c6f533c-99e8-4e04-b3d4-d6c11c67c862 req-be964472-5c87-4710-a678-48618a3ee40a service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:08.543544 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-9c6f533c-99e8-4e04-b3d4-d6c11c67c862 req-be964472-5c87-4710-a678-48618a3ee40a service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:08.544004 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-9c6f533c-99e8-4e04-b3d4-d6c11c67c862 req-be964472-5c87-4710-a678-48618a3ee40a service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:08.558653 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-9c6f533c-99e8-4e04-b3d4-d6c11c67c862 req-be964472-5c87-4710-a678-48618a3ee40a service nova] Creating event network-changed:05830bf8-556a-469a-9d00-f97cadfd56ba for instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e on hv-cinder-85221 Aug 31 00:30:08.564626 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-9c6f533c-99e8-4e04-b3d4-d6c11c67c862 req-be964472-5c87-4710-a678-48618a3ee40a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040505 Aug 31 00:30:08.565746 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 494/1007] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:08.656084 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.objects.instance [None req-80f114a9-c8be-4cad-b8f8-6dc355438bb5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lazy-loading 'services' on Instance uuid d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e {{(pid=127118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:30:08.770645 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-80f114a9-c8be-4cad-b8f8-6dc355438bb5 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments/63cab0c7-76df-432f-8240-889e82e3812c" status: 202 len: 0 microversion: 2.1 time: 0.259243 Aug 31 00:30:08.773760 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 514/1008] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:30:08 2022] DELETE /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments/63cab0c7-76df-432f-8240-889e82e3812c => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:30:08.782585 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-b2dd9e2b-2b2d-4b81-ab56-f29c238ae31e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:08.785162 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-b2dd9e2b-2b2d-4b81-ab56-f29c238ae31e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:08.794570 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2dd9e2b-2b2d-4b81-ab56-f29c238ae31e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:08.800346 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2dd9e2b-2b2d-4b81-ab56-f29c238ae31e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:08.801272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2dd9e2b-2b2d-4b81-ab56-f29c238ae31e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:08.802333 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2dd9e2b-2b2d-4b81-ab56-f29c238ae31e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:08.803938 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2dd9e2b-2b2d-4b81-ab56-f29c238ae31e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:08.804857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-b2dd9e2b-2b2d-4b81-ab56-f29c238ae31e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:08.901658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-b2dd9e2b-2b2d-4b81-ab56-f29c238ae31e tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122890 Aug 31 00:30:08.909041 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 495/1009] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:30:08 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:09.693906 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-608518159", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "networks": [{"uuid": "6910a064-82ec-43cb-85e4-b1c3f224a55e"}]}} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:09.787605 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.network.neutron [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] validate_networks() for [('6910a064-82ec-43cb-85e4-b1c3f224a55e', None, None, None, None, None)] {{(pid=127118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:30:09.937053 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-f4d6a891-ada3-4f44-8bdd-99df9c5c8c1b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:09.944569 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-f4d6a891-ada3-4f44-8bdd-99df9c5c8c1b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:09.984478 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4d6a891-ada3-4f44-8bdd-99df9c5c8c1b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:09.985950 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4d6a891-ada3-4f44-8bdd-99df9c5c8c1b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:09.987228 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4d6a891-ada3-4f44-8bdd-99df9c5c8c1b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:09.998021 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4d6a891-ada3-4f44-8bdd-99df9c5c8c1b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:09.999751 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4d6a891-ada3-4f44-8bdd-99df9c5c8c1b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:10.000993 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-f4d6a891-ada3-4f44-8bdd-99df9c5c8c1b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:10.119461 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-f4d6a891-ada3-4f44-8bdd-99df9c5c8c1b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204075 Aug 31 00:30:10.120672 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 496/1010] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:30:09 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:10.846952 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Flavor limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:30:10.847708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Image limits 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:30:10.848054 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Flavor pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:30:10.848563 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Image pref 0:0:0 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:30:10.849089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.virt.hardware [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:30:10.862407 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:10.863099 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:10.863885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:10.866119 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:10.867264 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:10.868207 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:10.893278 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Getting quotas for project 0c60f381dfb74597b07208b0c080987f. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:30:10.899135 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.quota [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Getting quotas for user 4f5ea3b457d546b0b9c362085a90e2ed and project 0c60f381dfb74597b07208b0c080987f. Resources: {'instances', 'cores', 'ram'} {{(pid=127118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:30:10.918194 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Going to run 1 instances... {{(pid=127118) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:30:10.921192 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:30:10.999838 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [cd58c6ef-6302-4002-98e1-4d35767065a3] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 00:30:11.136492 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-61e6ba8b-b085-4baf-b3c1-03ea95f50673 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:11.139652 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-61e6ba8b-b085-4baf-b3c1-03ea95f50673 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:11.149382 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-61e6ba8b-b085-4baf-b3c1-03ea95f50673 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:11.150132 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-61e6ba8b-b085-4baf-b3c1-03ea95f50673 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:11.151036 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-61e6ba8b-b085-4baf-b3c1-03ea95f50673 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:11.151781 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-61e6ba8b-b085-4baf-b3c1-03ea95f50673 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:11.152290 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-61e6ba8b-b085-4baf-b3c1-03ea95f50673 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:11.152724 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-61e6ba8b-b085-4baf-b3c1-03ea95f50673 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:11.188596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-61e6ba8b-b085-4baf-b3c1-03ea95f50673 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056984 Aug 31 00:30:11.189192 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 497/1011] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 31 00:30:11 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 00:30:11.204863 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:11.205452 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:11.212316 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:11.213160 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:11.213658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:11.214402 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:11.214866 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:11.215294 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:11.311898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] HTTP exception thrown: Instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e is not attached to volume 63cab0c7-76df-432f-8240-889e82e3812c Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Request method failure captured: Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: DELETE /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments/63cab0c7-76df-432f-8240-889e82e3812c HTTP/1.1 Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqro4ae9GYWs3Mz6uIex841_yRKaaG10MmlICddS8alYN1Y7s8Wtm6oZ1C6YsleqTe4fAA4OiuxlrUet2ECSRnttda49pE3QAmoSIihCXFVGo25F34GnKuEveQgGxywBEfyew1ONKD9EuLbOnoYh4lIDdrJqI_cinkx6nBmB94jFbic Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: d2b2473cfa244cf1aaaa6e4dac08a3d6 Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-TestMinimumBasicScenario-847986191 Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:30:11.317006 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:30:11.319837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d2b2473cfa244cf1aaaa6e4dac08a3d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d2b2473cfa244cf1aaaa6e4dac08a3d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d2b2473cfa244cf1aaaa6e4dac08a3d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d2b2473cfa244cf1aaaa6e4dac08a3d6"}]}] Aug 31 00:30:11.319837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-TestMinimumBasicScenario-847986191 Aug 31 00:30:11.319837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: d2b2473cfa244cf1aaaa6e4dac08a3d6 Aug 31 00:30:11.319837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-TestMinimumBasicScenario-847986191 Aug 31 00:30:11.319837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-TestMinimumBasicScenario-847986191-project Aug 31 00:30:11.319837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:30:11.319837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:30:11.319837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: cacf8da1fc48427eacc993769c4f9f3a Aug 31 00:30:11.319837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-TestMinimumBasicScenario-847986191-project Aug 31 00:30:11.319837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:30:11.319837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e is not attached to volume 63cab0c7-76df-432f-8240-889e82e3812c Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'server_id': 'd09bf6c9-9882-4470-8e58-bb8aa1a1ca1e', 'id': '63cab0c7-76df-432f-8240-889e82e3812c'} Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 63cab0c7-76df-432f-8240-889e82e3812c. Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:11.322799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e is not attached to volume 63cab0c7-76df-432f-8240-889e82e3812c Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e is not attached to volume 63cab0c7-76df-432f-8240-889e82e3812c Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:30:11.324898 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Returning 404 to user: Instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e is not attached to volume 63cab0c7-76df-432f-8240-889e82e3812c {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:11.326312 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c25c41dc-d7d0-4e61-b13b-49151a5b6dc0 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments/63cab0c7-76df-432f-8240-889e82e3812c" status: 404 len: 154 microversion: 2.1 time: 0.119448 Aug 31 00:30:11.326312 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 498/1012] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 31 00:30:11 2022] DELETE /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e/os-volume_attachments/63cab0c7-76df-432f-8240-889e82e3812c => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:12.019059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO oslo.messaging._drivers.impl_rabbit [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [cd58c6ef-6302-4002-98e1-4d35767065a3] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 41694. Aug 31 00:30:12.027883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0dde34c9-c2a2-45b7-9aa4-a8cf1cbe6b12 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.350325 Aug 31 00:30:12.028806 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 515/1013] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:30:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:30:12.045650 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-ad4cf127-908c-411d-9e28-866c9de8812d tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:12.046435 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-ad4cf127-908c-411d-9e28-866c9de8812d tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:12.146866 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-ad4cf127-908c-411d-9e28-866c9de8812d tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:12.157701 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-ad4cf127-908c-411d-9e28-866c9de8812d tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1213 microversion: 2.1 time: 0.115891 Aug 31 00:30:12.158646 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 499/1014] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:12 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1213 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:12.577875 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0faa4f02-acb9-42e6-814e-ddb261887797 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:12.579072 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0faa4f02-acb9-42e6-814e-ddb261887797 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:12.593335 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0faa4f02-acb9-42e6-814e-ddb261887797 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:12.594028 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0faa4f02-acb9-42e6-814e-ddb261887797 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:12.594732 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0faa4f02-acb9-42e6-814e-ddb261887797 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:12.595712 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0faa4f02-acb9-42e6-814e-ddb261887797 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:12.596630 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0faa4f02-acb9-42e6-814e-ddb261887797 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:12.597689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0faa4f02-acb9-42e6-814e-ddb261887797 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:12.645325 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0faa4f02-acb9-42e6-814e-ddb261887797 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Going to try to terminate instance {{(pid=127118) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:30:12.760383 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0faa4f02-acb9-42e6-814e-ddb261887797 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 204 len: 0 microversion: 2.1 time: 0.189841 Aug 31 00:30:12.762382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 516/1015] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:30:12 2022] DELETE /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:30:12.774391 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4745a5b3-efe2-4d9c-9f4d-10b6935d63b4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:12.776613 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-4745a5b3-efe2-4d9c-9f4d-10b6935d63b4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:12.789297 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4745a5b3-efe2-4d9c-9f4d-10b6935d63b4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:12.790644 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4745a5b3-efe2-4d9c-9f4d-10b6935d63b4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:12.792566 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4745a5b3-efe2-4d9c-9f4d-10b6935d63b4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:12.793841 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4745a5b3-efe2-4d9c-9f4d-10b6935d63b4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:12.794469 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4745a5b3-efe2-4d9c-9f4d-10b6935d63b4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:12.795077 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-4745a5b3-efe2-4d9c-9f4d-10b6935d63b4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:12.977199 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-4745a5b3-efe2-4d9c-9f4d-10b6935d63b4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:12.989764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4745a5b3-efe2-4d9c-9f4d-10b6935d63b4 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1552 microversion: 2.1 time: 0.220548 Aug 31 00:30:12.989764 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 500/1016] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:12 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1552 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:13.186103 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-57f1f024-8e91-41c2-967f-4f1bdafe607c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:13.187421 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-57f1f024-8e91-41c2-967f-4f1bdafe607c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:13.199492 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57f1f024-8e91-41c2-967f-4f1bdafe607c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:13.200528 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57f1f024-8e91-41c2-967f-4f1bdafe607c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:13.201259 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57f1f024-8e91-41c2-967f-4f1bdafe607c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:13.202260 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57f1f024-8e91-41c2-967f-4f1bdafe607c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:13.203038 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57f1f024-8e91-41c2-967f-4f1bdafe607c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:13.203735 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-57f1f024-8e91-41c2-967f-4f1bdafe607c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:13.314992 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-57f1f024-8e91-41c2-967f-4f1bdafe607c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:13.325604 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-57f1f024-8e91-41c2-967f-4f1bdafe607c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1209 microversion: 2.1 time: 0.148183 Aug 31 00:30:13.326327 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 517/1017] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:13 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1209 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:14.011299 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-01e9169b-d6e3-467e-ba4c-9809ceab7f9b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:14.012524 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-01e9169b-d6e3-467e-ba4c-9809ceab7f9b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:14.025637 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01e9169b-d6e3-467e-ba4c-9809ceab7f9b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:14.026645 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01e9169b-d6e3-467e-ba4c-9809ceab7f9b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:14.027519 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01e9169b-d6e3-467e-ba4c-9809ceab7f9b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:14.029288 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01e9169b-d6e3-467e-ba4c-9809ceab7f9b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:14.030232 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01e9169b-d6e3-467e-ba4c-9809ceab7f9b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:14.031026 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-01e9169b-d6e3-467e-ba4c-9809ceab7f9b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:14.225931 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-01e9169b-d6e3-467e-ba4c-9809ceab7f9b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:14.237440 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-01e9169b-d6e3-467e-ba4c-9809ceab7f9b tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1552 microversion: 2.1 time: 0.230760 Aug 31 00:30:14.237837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 501/1018] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:14 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:14.352209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-fb3c1116-c5af-47a0-9325-69bd19e81387 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:14.354992 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-fb3c1116-c5af-47a0-9325-69bd19e81387 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:14.368031 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb3c1116-c5af-47a0-9325-69bd19e81387 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:14.369871 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb3c1116-c5af-47a0-9325-69bd19e81387 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:14.370455 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb3c1116-c5af-47a0-9325-69bd19e81387 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:14.372096 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb3c1116-c5af-47a0-9325-69bd19e81387 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:14.373252 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb3c1116-c5af-47a0-9325-69bd19e81387 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:14.374027 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-fb3c1116-c5af-47a0-9325-69bd19e81387 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:14.473157 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-fb3c1116-c5af-47a0-9325-69bd19e81387 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:14.485683 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-fb3c1116-c5af-47a0-9325-69bd19e81387 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1209 microversion: 2.1 time: 0.140898 Aug 31 00:30:14.486547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 518/1019] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:14 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1209 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:15.301074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-59850d3a-1e5b-4488-903f-d4feb7d96414 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:15.303441 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-59850d3a-1e5b-4488-903f-d4feb7d96414 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:15.317691 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59850d3a-1e5b-4488-903f-d4feb7d96414 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:15.319619 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59850d3a-1e5b-4488-903f-d4feb7d96414 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:15.320849 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59850d3a-1e5b-4488-903f-d4feb7d96414 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:15.323539 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59850d3a-1e5b-4488-903f-d4feb7d96414 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:15.325039 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59850d3a-1e5b-4488-903f-d4feb7d96414 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:15.326106 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-59850d3a-1e5b-4488-903f-d4feb7d96414 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:15.519677 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-82c85f9b-0964-4d1c-91a8-f8e3b9eecfdf tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:15.524078 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-82c85f9b-0964-4d1c-91a8-f8e3b9eecfdf tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:15.546106 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-82c85f9b-0964-4d1c-91a8-f8e3b9eecfdf tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:15.546825 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-82c85f9b-0964-4d1c-91a8-f8e3b9eecfdf tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:15.549684 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-82c85f9b-0964-4d1c-91a8-f8e3b9eecfdf tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:15.550452 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-82c85f9b-0964-4d1c-91a8-f8e3b9eecfdf tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:15.550917 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-82c85f9b-0964-4d1c-91a8-f8e3b9eecfdf tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:15.551405 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-82c85f9b-0964-4d1c-91a8-f8e3b9eecfdf tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:15.623488 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-59850d3a-1e5b-4488-903f-d4feb7d96414 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacf8da1fc48427eacc993769c4f9f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:15.640815 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-59850d3a-1e5b-4488-903f-d4feb7d96414 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 200 len: 1510 microversion: 2.1 time: 0.350655 Aug 31 00:30:15.642153 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 502/1020] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:15 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:15.661516 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-48f839d5-2cc0-4085-99b5-c3372b77774c req-3168efaa-dd26-42bb-af56-54cbf4f0d2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e", "name": "network-vif-deleted", "tag": "05830bf8-556a-469a-9d00-f97cadfd56ba"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:15.676135 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-82c85f9b-0964-4d1c-91a8-f8e3b9eecfdf tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:15.676544 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-48f839d5-2cc0-4085-99b5-c3372b77774c req-3168efaa-dd26-42bb-af56-54cbf4f0d2c2 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:15.676978 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-48f839d5-2cc0-4085-99b5-c3372b77774c req-3168efaa-dd26-42bb-af56-54cbf4f0d2c2 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:15.677431 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-48f839d5-2cc0-4085-99b5-c3372b77774c req-3168efaa-dd26-42bb-af56-54cbf4f0d2c2 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:15.691700 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-82c85f9b-0964-4d1c-91a8-f8e3b9eecfdf tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1271 microversion: 2.1 time: 0.179337 Aug 31 00:30:15.692667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 519/1021] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:15 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:15.705074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-48f839d5-2cc0-4085-99b5-c3372b77774c req-3168efaa-dd26-42bb-af56-54cbf4f0d2c2 service nova] Creating event network-vif-deleted:05830bf8-556a-469a-9d00-f97cadfd56ba for instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e on hv-cinder-85221 Aug 31 00:30:15.716650 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-48f839d5-2cc0-4085-99b5-c3372b77774c req-3168efaa-dd26-42bb-af56-54cbf4f0d2c2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072387 Aug 31 00:30:15.718173 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 503/1022] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:16.673558 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:16.674693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] [instance: d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:16.695800 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:16.695800 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:16.695800 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:16.695800 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:16.713313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:16.713313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:16.735788 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8079401a-75ba-47b1-8a8d-e8ec2d9de8e2 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:16.736577 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8079401a-75ba-47b1-8a8d-e8ec2d9de8e2 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:16.744419 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] HTTP exception thrown: Instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e could not be found. Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Request method failure captured: Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e HTTP/1.1 Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqro4ae9GYWs3Mz6uIex841_yRKaaG10MmlICddS8alYN1Y7s8Wtm6oZ1C6YsleqTe4fAA4OiuxlrUet2ECSRnttda49pE3QAmoSIihCXFVGo25F34GnKuEveQgGxywBEfyew1ONKD9EuLbOnoYh4lIDdrJqI_cinkx6nBmB94jFbic Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: d2b2473cfa244cf1aaaa6e4dac08a3d6 Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-TestMinimumBasicScenario-847986191 Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:30:16.747812 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d2b2473cfa244cf1aaaa6e4dac08a3d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d2b2473cfa244cf1aaaa6e4dac08a3d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d2b2473cfa244cf1aaaa6e4dac08a3d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d2b2473cfa244cf1aaaa6e4dac08a3d6"}]}] Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-TestMinimumBasicScenario-847986191 Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: d2b2473cfa244cf1aaaa6e4dac08a3d6 Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-TestMinimumBasicScenario-847986191 Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-TestMinimumBasicScenario-847986191-project Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: cacf8da1fc48427eacc993769c4f9f3a Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-TestMinimumBasicScenario-847986191-project Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e could not be found. Aug 31 00:30:16.750090 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'd09bf6c9-9882-4470-8e58-bb8aa1a1ca1e'} Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e could not be found. Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:16.751439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e could not be found. Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e could not be found. Aug 31 00:30:16.753533 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:16.755378 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Returning 404 to user: Instance d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:16.755378 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4dc93ba9-fcff-4bb2-8b9d-1cae701378c9 tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e" status: 404 len: 111 microversion: 2.1 time: 0.087040 Aug 31 00:30:16.755378 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 520/1023] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:16 2022] GET /compute/v2.1/servers/d09bf6c9-9882-4470-8e58-bb8aa1a1ca1e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:16.756679 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8079401a-75ba-47b1-8a8d-e8ec2d9de8e2 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:16.757212 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8079401a-75ba-47b1-8a8d-e8ec2d9de8e2 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:16.758164 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8079401a-75ba-47b1-8a8d-e8ec2d9de8e2 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:16.759854 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8079401a-75ba-47b1-8a8d-e8ec2d9de8e2 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:16.760603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8079401a-75ba-47b1-8a8d-e8ec2d9de8e2 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:16.761226 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8079401a-75ba-47b1-8a8d-e8ec2d9de8e2 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:16.769865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-6dae22c1-0706-4c1f-ab81-1d27b54cdcde tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] Calling method '.version_select at 0x7f1a3a86fca0>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:16.810107 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-6dae22c1-0706-4c1f-ab81-1d27b54cdcde tempest-TestMinimumBasicScenario-847986191 tempest-TestMinimumBasicScenario-847986191-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-64917146" status: 202 len: 0 microversion: 2.1 time: 0.049750 Aug 31 00:30:16.811540 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 521/1024] 10.222.0.47 () {58 vars in 1266 bytes} [Wed Aug 31 00:30:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-64917146 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:30:17.165683 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8079401a-75ba-47b1-8a8d-e8ec2d9de8e2 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:17.179594 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8079401a-75ba-47b1-8a8d-e8ec2d9de8e2 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1313 microversion: 2.1 time: 0.450722 Aug 31 00:30:17.181134 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 504/1025] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:16 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:17.770104 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-3222b8f5-b12b-44b3-a4be-848a942c1fb6 req-7e37cc9f-bf65-4c34-b660-13c7d93a1c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7336ca4-d219-4418-8555-efa2696dffa5", "tag": "4795b28e-528c-4888-8960-a9f1a7203303"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:17.805143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3222b8f5-b12b-44b3-a4be-848a942c1fb6 req-7e37cc9f-bf65-4c34-b660-13c7d93a1c87 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:17.806136 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3222b8f5-b12b-44b3-a4be-848a942c1fb6 req-7e37cc9f-bf65-4c34-b660-13c7d93a1c87 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:17.806766 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-3222b8f5-b12b-44b3-a4be-848a942c1fb6 req-7e37cc9f-bf65-4c34-b660-13c7d93a1c87 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:17.830387 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-3222b8f5-b12b-44b3-a4be-848a942c1fb6 req-7e37cc9f-bf65-4c34-b660-13c7d93a1c87 service nova] Creating event network-changed:4795b28e-528c-4888-8960-a9f1a7203303 for instance e7336ca4-d219-4418-8555-efa2696dffa5 on hv-cinder-85221 Aug 31 00:30:17.843787 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-3222b8f5-b12b-44b3-a4be-848a942c1fb6 req-7e37cc9f-bf65-4c34-b660-13c7d93a1c87 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078677 Aug 31 00:30:17.845948 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 522/1026] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:30:18.224817 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e4803197-9247-43aa-ae7b-670dbd122e94 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:18.225709 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e4803197-9247-43aa-ae7b-670dbd122e94 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:18.233353 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e4803197-9247-43aa-ae7b-670dbd122e94 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:18.233990 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e4803197-9247-43aa-ae7b-670dbd122e94 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:18.234945 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e4803197-9247-43aa-ae7b-670dbd122e94 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:18.235883 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e4803197-9247-43aa-ae7b-670dbd122e94 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:18.236809 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e4803197-9247-43aa-ae7b-670dbd122e94 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:18.237342 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e4803197-9247-43aa-ae7b-670dbd122e94 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:18.525641 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e4803197-9247-43aa-ae7b-670dbd122e94 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:18.541913 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e4803197-9247-43aa-ae7b-670dbd122e94 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1313 microversion: 2.1 time: 0.324858 Aug 31 00:30:18.543987 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 505/1027] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:18 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:19.577293 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-936934e7-00aa-42cf-88ad-8ac4d987c84a tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:19.578154 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-936934e7-00aa-42cf-88ad-8ac4d987c84a tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:19.594956 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-936934e7-00aa-42cf-88ad-8ac4d987c84a tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:19.596011 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-936934e7-00aa-42cf-88ad-8ac4d987c84a tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:19.599013 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-936934e7-00aa-42cf-88ad-8ac4d987c84a tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:19.604321 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-936934e7-00aa-42cf-88ad-8ac4d987c84a tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:19.605168 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-936934e7-00aa-42cf-88ad-8ac4d987c84a tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:19.606118 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-936934e7-00aa-42cf-88ad-8ac4d987c84a tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:20.080085 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-936934e7-00aa-42cf-88ad-8ac4d987c84a tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:20.095409 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-936934e7-00aa-42cf-88ad-8ac4d987c84a tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1313 microversion: 2.1 time: 0.523065 Aug 31 00:30:20.102768 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 523/1028] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:19 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:21.155739 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-65a8121c-761a-41b8-9526-a0d371f0fb68 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:21.157547 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-65a8121c-761a-41b8-9526-a0d371f0fb68 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:21.175948 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-65a8121c-761a-41b8-9526-a0d371f0fb68 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:21.176848 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-65a8121c-761a-41b8-9526-a0d371f0fb68 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:21.177768 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-65a8121c-761a-41b8-9526-a0d371f0fb68 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:21.180032 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-65a8121c-761a-41b8-9526-a0d371f0fb68 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:21.181478 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-65a8121c-761a-41b8-9526-a0d371f0fb68 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:21.182500 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-65a8121c-761a-41b8-9526-a0d371f0fb68 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:21.407013 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-65a8121c-761a-41b8-9526-a0d371f0fb68 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:21.417285 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-65a8121c-761a-41b8-9526-a0d371f0fb68 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1313 microversion: 2.1 time: 0.273093 Aug 31 00:30:21.419263 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 506/1029] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:21 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:22.444656 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-d5de5704-f5e9-4876-8c7f-2b405c263938 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:22.446796 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-d5de5704-f5e9-4876-8c7f-2b405c263938 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:22.451539 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:22.453164 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=6 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:22.469307 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5de5704-f5e9-4876-8c7f-2b405c263938 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:22.470914 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5de5704-f5e9-4876-8c7f-2b405c263938 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:22.472636 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5de5704-f5e9-4876-8c7f-2b405c263938 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:22.474263 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5de5704-f5e9-4876-8c7f-2b405c263938 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:22.475409 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5de5704-f5e9-4876-8c7f-2b405c263938 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:22.476466 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-d5de5704-f5e9-4876-8c7f-2b405c263938 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:22.945410 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-d5de5704-f5e9-4876-8c7f-2b405c263938 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:22.980547 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-d5de5704-f5e9-4876-8c7f-2b405c263938 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1313 microversion: 2.1 time: 0.543410 Aug 31 00:30:22.985675 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 524/1030] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:22 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1313 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:24.015685 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-de314bfa-d557-4d2f-8ca3-a4631d0ff6ce tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:24.016468 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-de314bfa-d557-4d2f-8ca3-a4631d0ff6ce tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:24.019120 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:24.033420 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de314bfa-d557-4d2f-8ca3-a4631d0ff6ce tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:24.033916 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de314bfa-d557-4d2f-8ca3-a4631d0ff6ce tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:24.034375 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de314bfa-d557-4d2f-8ca3-a4631d0ff6ce tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:24.035110 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de314bfa-d557-4d2f-8ca3-a4631d0ff6ce tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:24.037016 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de314bfa-d557-4d2f-8ca3-a4631d0ff6ce tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:24.037468 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-de314bfa-d557-4d2f-8ca3-a4631d0ff6ce tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:24.358814 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-b04e602d-1228-4ece-a4b9-6d1bd648a897 req-c8bad7f4-0211-4b16-8831-ce7851c969ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7336ca4-d219-4418-8555-efa2696dffa5", "name": "network-vif-plugged", "status": "completed", "tag": "4795b28e-528c-4888-8960-a9f1a7203303"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:24.373443 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-b04e602d-1228-4ece-a4b9-6d1bd648a897 req-c8bad7f4-0211-4b16-8831-ce7851c969ae service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:24.374258 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-b04e602d-1228-4ece-a4b9-6d1bd648a897 req-c8bad7f4-0211-4b16-8831-ce7851c969ae service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:24.374884 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-b04e602d-1228-4ece-a4b9-6d1bd648a897 req-c8bad7f4-0211-4b16-8831-ce7851c969ae service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:24.390096 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-b04e602d-1228-4ece-a4b9-6d1bd648a897 req-c8bad7f4-0211-4b16-8831-ce7851c969ae service nova] Creating event network-vif-plugged:4795b28e-528c-4888-8960-a9f1a7203303 for instance e7336ca4-d219-4418-8555-efa2696dffa5 on hv-cinder-85221 Aug 31 00:30:24.397861 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-b04e602d-1228-4ece-a4b9-6d1bd648a897 req-c8bad7f4-0211-4b16-8831-ce7851c969ae service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045560 Aug 31 00:30:24.398561 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 525/1031] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:30:24.637059 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-de314bfa-d557-4d2f-8ca3-a4631d0ff6ce tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:24.652522 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-de314bfa-d557-4d2f-8ca3-a4631d0ff6ce tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1313 microversion: 2.1 time: 0.640380 Aug 31 00:30:24.653560 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 507/1032] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:24 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:25.693046 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b657e929-202e-441e-a8ba-a1bbf758f76f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:25.694327 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b657e929-202e-441e-a8ba-a1bbf758f76f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:25.705640 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b657e929-202e-441e-a8ba-a1bbf758f76f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:25.706965 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b657e929-202e-441e-a8ba-a1bbf758f76f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:25.707595 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b657e929-202e-441e-a8ba-a1bbf758f76f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:25.709128 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b657e929-202e-441e-a8ba-a1bbf758f76f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:25.710004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b657e929-202e-441e-a8ba-a1bbf758f76f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:25.710902 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b657e929-202e-441e-a8ba-a1bbf758f76f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:25.979194 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-b657e929-202e-441e-a8ba-a1bbf758f76f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:25.994252 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b657e929-202e-441e-a8ba-a1bbf758f76f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1313 microversion: 2.1 time: 0.310414 Aug 31 00:30:25.995046 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 526/1033] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:25 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:27.037233 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c1d1fe7c-3113-4e46-9575-24b9ea826116 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:27.038618 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c1d1fe7c-3113-4e46-9575-24b9ea826116 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:27.075554 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c1d1fe7c-3113-4e46-9575-24b9ea826116 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:27.078584 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c1d1fe7c-3113-4e46-9575-24b9ea826116 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:27.079305 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c1d1fe7c-3113-4e46-9575-24b9ea826116 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:27.080405 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c1d1fe7c-3113-4e46-9575-24b9ea826116 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:27.082987 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c1d1fe7c-3113-4e46-9575-24b9ea826116 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:27.083931 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c1d1fe7c-3113-4e46-9575-24b9ea826116 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:27.901989 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c1d1fe7c-3113-4e46-9575-24b9ea826116 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:27.919035 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c1d1fe7c-3113-4e46-9575-24b9ea826116 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1313 microversion: 2.1 time: 0.893392 Aug 31 00:30:27.920870 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 508/1034] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:27 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1313 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:28.941956 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-633e22fd-5593-4e57-b5d2-9fe77f1e11e8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:28.942687 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-633e22fd-5593-4e57-b5d2-9fe77f1e11e8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:28.950979 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-633e22fd-5593-4e57-b5d2-9fe77f1e11e8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:28.951470 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-633e22fd-5593-4e57-b5d2-9fe77f1e11e8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:28.952336 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-633e22fd-5593-4e57-b5d2-9fe77f1e11e8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:28.953272 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-633e22fd-5593-4e57-b5d2-9fe77f1e11e8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:28.953801 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-633e22fd-5593-4e57-b5d2-9fe77f1e11e8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:28.954317 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-633e22fd-5593-4e57-b5d2-9fe77f1e11e8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:29.352182 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-633e22fd-5593-4e57-b5d2-9fe77f1e11e8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:29.363018 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-633e22fd-5593-4e57-b5d2-9fe77f1e11e8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1313 microversion: 2.1 time: 0.425233 Aug 31 00:30:29.371039 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 527/1035] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:28 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:30.391814 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-27ac4690-db81-46df-a92e-374baf55d377 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:30.392772 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-27ac4690-db81-46df-a92e-374baf55d377 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:30.402755 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27ac4690-db81-46df-a92e-374baf55d377 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:30.403673 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27ac4690-db81-46df-a92e-374baf55d377 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:30.404704 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27ac4690-db81-46df-a92e-374baf55d377 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:30.405988 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27ac4690-db81-46df-a92e-374baf55d377 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:30.406812 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27ac4690-db81-46df-a92e-374baf55d377 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:30.407648 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-27ac4690-db81-46df-a92e-374baf55d377 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:30.677054 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-27ac4690-db81-46df-a92e-374baf55d377 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:30.693983 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-27ac4690-db81-46df-a92e-374baf55d377 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1313 microversion: 2.1 time: 0.305845 Aug 31 00:30:30.695275 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 509/1036] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:30 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:31.731742 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-42dbd1df-2074-426d-bf1d-95cf37ec89d4 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:31.732429 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-42dbd1df-2074-426d-bf1d-95cf37ec89d4 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:31.739622 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42dbd1df-2074-426d-bf1d-95cf37ec89d4 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:31.740314 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42dbd1df-2074-426d-bf1d-95cf37ec89d4 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:31.741072 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42dbd1df-2074-426d-bf1d-95cf37ec89d4 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:31.742193 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42dbd1df-2074-426d-bf1d-95cf37ec89d4 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:31.743460 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42dbd1df-2074-426d-bf1d-95cf37ec89d4 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:31.744058 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-42dbd1df-2074-426d-bf1d-95cf37ec89d4 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:31.913771 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-42dbd1df-2074-426d-bf1d-95cf37ec89d4 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:31.928538 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-42dbd1df-2074-426d-bf1d-95cf37ec89d4 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1498 microversion: 2.1 time: 0.201200 Aug 31 00:30:31.929667 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 528/1037] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:31 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1498 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:34.775658 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6840a19f-adc3-40b0-82b4-070fb6d3beac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:34.776273 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6840a19f-adc3-40b0-82b4-070fb6d3beac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:34.783209 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6840a19f-adc3-40b0-82b4-070fb6d3beac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:34.783701 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6840a19f-adc3-40b0-82b4-070fb6d3beac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:34.784137 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6840a19f-adc3-40b0-82b4-070fb6d3beac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:34.784890 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6840a19f-adc3-40b0-82b4-070fb6d3beac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:34.785347 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6840a19f-adc3-40b0-82b4-070fb6d3beac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:34.785773 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6840a19f-adc3-40b0-82b4-070fb6d3beac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:34.818708 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6840a19f-adc3-40b0-82b4-070fb6d3beac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:30:34.880500 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:34.917374 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6840a19f-adc3-40b0-82b4-070fb6d3beac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 204 len: 0 microversion: 2.1 time: 0.145512 Aug 31 00:30:34.918380 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 510/1038] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:30:34 2022] DELETE /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:30:34.931135 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a0bc64f7-61a5-43e6-bfad-51bbaf578d38 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:34.931899 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a0bc64f7-61a5-43e6-bfad-51bbaf578d38 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:34.939028 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0bc64f7-61a5-43e6-bfad-51bbaf578d38 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:34.939518 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0bc64f7-61a5-43e6-bfad-51bbaf578d38 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:34.939955 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0bc64f7-61a5-43e6-bfad-51bbaf578d38 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:34.940751 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0bc64f7-61a5-43e6-bfad-51bbaf578d38 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:34.941179 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0bc64f7-61a5-43e6-bfad-51bbaf578d38 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:34.941600 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a0bc64f7-61a5-43e6-bfad-51bbaf578d38 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:35.378545 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a0bc64f7-61a5-43e6-bfad-51bbaf578d38 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:35.394898 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a0bc64f7-61a5-43e6-bfad-51bbaf578d38 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1504 microversion: 2.1 time: 0.468674 Aug 31 00:30:35.395986 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 529/1039] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:34 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1504 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:36.420830 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-e5c96a5a-d9dd-4f30-9157-d5cd9b7dcfe8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:36.421694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-e5c96a5a-d9dd-4f30-9157-d5cd9b7dcfe8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:36.428817 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5c96a5a-d9dd-4f30-9157-d5cd9b7dcfe8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:36.429315 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5c96a5a-d9dd-4f30-9157-d5cd9b7dcfe8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:36.429759 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5c96a5a-d9dd-4f30-9157-d5cd9b7dcfe8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:36.430504 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5c96a5a-d9dd-4f30-9157-d5cd9b7dcfe8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:36.430959 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5c96a5a-d9dd-4f30-9157-d5cd9b7dcfe8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:36.431388 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-e5c96a5a-d9dd-4f30-9157-d5cd9b7dcfe8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:36.627189 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-e5c96a5a-d9dd-4f30-9157-d5cd9b7dcfe8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:36.637414 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-e5c96a5a-d9dd-4f30-9157-d5cd9b7dcfe8 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1504 microversion: 2.1 time: 0.220964 Aug 31 00:30:36.638035 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 511/1040] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:36 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:37.100981 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-a1a4b738-842b-4b08-aaa0-439ec70d9d36 req-8c07a532-b89c-4fa6-a1a3-2176d16453a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7336ca4-d219-4418-8555-efa2696dffa5", "name": "network-vif-deleted", "tag": "4795b28e-528c-4888-8960-a9f1a7203303"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:37.110885 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:37.119204 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-a1a4b738-842b-4b08-aaa0-439ec70d9d36 req-8c07a532-b89c-4fa6-a1a3-2176d16453a7 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:37.119693 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-a1a4b738-842b-4b08-aaa0-439ec70d9d36 req-8c07a532-b89c-4fa6-a1a3-2176d16453a7 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:37.120440 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-a1a4b738-842b-4b08-aaa0-439ec70d9d36 req-8c07a532-b89c-4fa6-a1a3-2176d16453a7 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:37.124039 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:37.137890 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-a1a4b738-842b-4b08-aaa0-439ec70d9d36 req-8c07a532-b89c-4fa6-a1a3-2176d16453a7 service nova] Creating event network-vif-deleted:4795b28e-528c-4888-8960-a9f1a7203303 for instance e7336ca4-d219-4418-8555-efa2696dffa5 on hv-cinder-85221 Aug 31 00:30:37.143673 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-a1a4b738-842b-4b08-aaa0-439ec70d9d36 req-8c07a532-b89c-4fa6-a1a3-2176d16453a7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050935 Aug 31 00:30:37.144446 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 530/1041] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:37.659332 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:37.660264 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:37.662719 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:37.669247 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:37.669744 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:37.670181 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:37.670901 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:37.671357 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:37.671779 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:37.727038 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:37.727993 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:37.728121 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:37.728616 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lazy-loading 'fault' on Instance uuid e7336ca4-d219-4418-8555-efa2696dffa5 {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:30:37.785461 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:37.795657 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-c682aa20-3873-4f32-9154-ec0e69c3dcfc tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 200 len: 1303 microversion: 2.1 time: 0.140240 Aug 31 00:30:37.796317 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 512/1042] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:37 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:38.830141 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:38.831068 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e7336ca4-d219-4418-8555-efa2696dffa5] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:38.840358 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:38.840857 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:38.841292 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:38.842008 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:38.842458 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:38.842886 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:38.859457 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] HTTP exception thrown: Instance e7336ca4-d219-4418-8555-efa2696dffa5 could not be found. Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Request method failure captured: Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 HTTP/1.1 Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDquP0VCUDVTaBGSyOsbhUzRVPrBs7cDx46yV4bZQGEc8qAjAV56sVkKFfEqZBZg9wVfeugTvuB7m-8-a0O0aSlywKUpy9eTj0n2RCgQzNOYpT05tUH2bN_OTzJFnm5OMgA_L5J4JdcI1LDEpLmvsmq9omKotSSiadbR1Fz0OK-0EKlw Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 0c60f381dfb74597b07208b0c080987f Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-VolumesActionsTest-1497485908 Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:30:38.861175 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c60f381dfb74597b07208b0c080987f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c60f381dfb74597b07208b0c080987f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c60f381dfb74597b07208b0c080987f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c60f381dfb74597b07208b0c080987f"}]}] Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-VolumesActionsTest-1497485908 Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 0c60f381dfb74597b07208b0c080987f Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-VolumesActionsTest-1497485908 Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-VolumesActionsTest-1497485908-project Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 4f5ea3b457d546b0b9c362085a90e2ed Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-VolumesActionsTest-1497485908-project Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance e7336ca4-d219-4418-8555-efa2696dffa5 could not be found. Aug 31 00:30:38.864077 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'e7336ca4-d219-4418-8555-efa2696dffa5'} Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7336ca4-d219-4418-8555-efa2696dffa5 could not be found. Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:38.865893 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7336ca4-d219-4418-8555-efa2696dffa5 could not be found. Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7336ca4-d219-4418-8555-efa2696dffa5 could not be found. Aug 31 00:30:38.870080 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:38.873719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Returning 404 to user: Instance e7336ca4-d219-4418-8555-efa2696dffa5 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:38.873719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3476f419-347c-457b-afc2-0dfd273633ff tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5" status: 404 len: 111 microversion: 2.1 time: 0.038493 Aug 31 00:30:38.873719 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 531/1043] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:38 2022] GET /compute/v2.1/servers/e7336ca4-d219-4418-8555-efa2696dffa5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:38.981069 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-923183680", "imageRef": "d2cd3fce-4175-421d-b27e-781ec9a59ecf", "flavorRef": "452", "networks": [{"uuid": "6910a064-82ec-43cb-85e4-b1c3f224a55e"}]}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:39.200940 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] validate_networks() for [('6910a064-82ec-43cb-85e4-b1c3f224a55e', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:30:39.658694 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:30:39.659474 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:30:39.660509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:30:39.661236 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:30:39.661922 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:30:39.681046 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.681919 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.682685 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.683847 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.684527 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.685185 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.717083 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Getting quotas for project 0c60f381dfb74597b07208b0c080987f. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:30:39.725326 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Getting quotas for user 4f5ea3b457d546b0b9c362085a90e2ed and project 0c60f381dfb74597b07208b0c080987f. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:30:39.749478 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:30:39.755396 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d2cd3fce-4175-421d-b27e-781ec9a59ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:30:39.848907 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-31eaebfa-1265-45f8-a81d-b7b726133916 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872733 Aug 31 00:30:39.849979 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 513/1044] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:30:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:30:39.863898 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a3843320-6d25-4f04-b8af-24f82e12843c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:39.864620 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a3843320-6d25-4f04-b8af-24f82e12843c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:39.942813 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a3843320-6d25-4f04-b8af-24f82e12843c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:39.952291 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a3843320-6d25-4f04-b8af-24f82e12843c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1213 microversion: 2.1 time: 0.093845 Aug 31 00:30:39.952901 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 532/1045] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:39 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:40.990908 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-99f046bc-1d53-4d28-b103-18f6b17bcd9e tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:40.992041 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-99f046bc-1d53-4d28-b103-18f6b17bcd9e tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:41.011256 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f046bc-1d53-4d28-b103-18f6b17bcd9e tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:41.011711 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f046bc-1d53-4d28-b103-18f6b17bcd9e tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:41.012230 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f046bc-1d53-4d28-b103-18f6b17bcd9e tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:41.016635 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f046bc-1d53-4d28-b103-18f6b17bcd9e tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:41.017398 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f046bc-1d53-4d28-b103-18f6b17bcd9e tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:41.018187 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-99f046bc-1d53-4d28-b103-18f6b17bcd9e tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:41.133150 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-99f046bc-1d53-4d28-b103-18f6b17bcd9e tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:41.151264 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-99f046bc-1d53-4d28-b103-18f6b17bcd9e tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1265 microversion: 2.1 time: 0.167990 Aug 31 00:30:41.152669 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 514/1046] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:40 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:42.178795 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c688a6e9-f341-44ec-8e5e-559d0609da5c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:42.181230 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c688a6e9-f341-44ec-8e5e-559d0609da5c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:42.192619 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c688a6e9-f341-44ec-8e5e-559d0609da5c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:42.193442 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c688a6e9-f341-44ec-8e5e-559d0609da5c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:42.194193 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c688a6e9-f341-44ec-8e5e-559d0609da5c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:42.195301 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c688a6e9-f341-44ec-8e5e-559d0609da5c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:42.197383 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c688a6e9-f341-44ec-8e5e-559d0609da5c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:42.199068 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c688a6e9-f341-44ec-8e5e-559d0609da5c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:42.434656 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c688a6e9-f341-44ec-8e5e-559d0609da5c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:42.451466 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c688a6e9-f341-44ec-8e5e-559d0609da5c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1313 microversion: 2.1 time: 0.278789 Aug 31 00:30:42.452403 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 533/1047] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:42 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:43.231098 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-d88f6232-1622-440f-a5d1-6b111817de67 req-dc57dafa-3b5c-4320-8999-7b788dc1525e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e12d74f5-9f9f-478e-b427-6cc06486040f", "tag": "5b228077-6303-443c-8524-ef7ada123f4c"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:43.252846 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d88f6232-1622-440f-a5d1-6b111817de67 req-dc57dafa-3b5c-4320-8999-7b788dc1525e service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:43.253741 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d88f6232-1622-440f-a5d1-6b111817de67 req-dc57dafa-3b5c-4320-8999-7b788dc1525e service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:43.254549 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d88f6232-1622-440f-a5d1-6b111817de67 req-dc57dafa-3b5c-4320-8999-7b788dc1525e service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:43.278577 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-d88f6232-1622-440f-a5d1-6b111817de67 req-dc57dafa-3b5c-4320-8999-7b788dc1525e service nova] Creating event network-changed:5b228077-6303-443c-8524-ef7ada123f4c for instance e12d74f5-9f9f-478e-b427-6cc06486040f on hv-cinder-85221 Aug 31 00:30:43.287319 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-d88f6232-1622-440f-a5d1-6b111817de67 req-dc57dafa-3b5c-4320-8999-7b788dc1525e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063889 Aug 31 00:30:43.288480 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 515/1048] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:43.480948 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-166c417e-d366-4922-ac2c-6234971955ba tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:43.481883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-166c417e-d366-4922-ac2c-6234971955ba tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:43.491565 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-166c417e-d366-4922-ac2c-6234971955ba tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:43.492873 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-166c417e-d366-4922-ac2c-6234971955ba tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:43.493448 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-166c417e-d366-4922-ac2c-6234971955ba tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:43.494494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-166c417e-d366-4922-ac2c-6234971955ba tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:43.495103 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-166c417e-d366-4922-ac2c-6234971955ba tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:43.495692 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-166c417e-d366-4922-ac2c-6234971955ba tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:43.812393 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-166c417e-d366-4922-ac2c-6234971955ba tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:43.821153 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-166c417e-d366-4922-ac2c-6234971955ba tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1313 microversion: 2.1 time: 0.348743 Aug 31 00:30:43.821742 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 534/1049] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:43 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:44.850918 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-34d2d19e-2e70-492b-a427-e3418073a7a9 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:44.852887 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-34d2d19e-2e70-492b-a427-e3418073a7a9 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:44.869598 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34d2d19e-2e70-492b-a427-e3418073a7a9 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:44.872976 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34d2d19e-2e70-492b-a427-e3418073a7a9 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:44.873532 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34d2d19e-2e70-492b-a427-e3418073a7a9 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:44.875192 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34d2d19e-2e70-492b-a427-e3418073a7a9 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:44.875192 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34d2d19e-2e70-492b-a427-e3418073a7a9 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:44.875192 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-34d2d19e-2e70-492b-a427-e3418073a7a9 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:45.159751 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-34d2d19e-2e70-492b-a427-e3418073a7a9 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:45.172586 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-34d2d19e-2e70-492b-a427-e3418073a7a9 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1313 microversion: 2.1 time: 0.331734 Aug 31 00:30:45.173190 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 516/1050] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:44 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:46.196569 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-1aaaaabb-e103-4a8d-8620-7cf0adca7448 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:46.198030 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-1aaaaabb-e103-4a8d-8620-7cf0adca7448 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:46.205995 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1aaaaabb-e103-4a8d-8620-7cf0adca7448 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:46.206489 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1aaaaabb-e103-4a8d-8620-7cf0adca7448 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:46.206927 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1aaaaabb-e103-4a8d-8620-7cf0adca7448 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:46.207689 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1aaaaabb-e103-4a8d-8620-7cf0adca7448 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:46.208169 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1aaaaabb-e103-4a8d-8620-7cf0adca7448 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:46.208601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-1aaaaabb-e103-4a8d-8620-7cf0adca7448 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:46.668199 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-1aaaaabb-e103-4a8d-8620-7cf0adca7448 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:46.683704 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-1aaaaabb-e103-4a8d-8620-7cf0adca7448 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1313 microversion: 2.1 time: 0.492616 Aug 31 00:30:46.684813 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 535/1051] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:46 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:47.720184 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3931ace1-f14e-429a-b464-b224130cd4aa tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:47.720838 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3931ace1-f14e-429a-b464-b224130cd4aa tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:47.729163 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3931ace1-f14e-429a-b464-b224130cd4aa tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:47.729655 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3931ace1-f14e-429a-b464-b224130cd4aa tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:47.730098 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3931ace1-f14e-429a-b464-b224130cd4aa tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:47.730825 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3931ace1-f14e-429a-b464-b224130cd4aa tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:47.731272 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3931ace1-f14e-429a-b464-b224130cd4aa tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:47.731721 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3931ace1-f14e-429a-b464-b224130cd4aa tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:47.907372 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3931ace1-f14e-429a-b464-b224130cd4aa tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:47.918607 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3931ace1-f14e-429a-b464-b224130cd4aa tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1313 microversion: 2.1 time: 0.202625 Aug 31 00:30:47.926060 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 517/1052] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:47 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:48.038462 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-c7c497f5-8fcb-4b09-81f0-c69fa693972d req-723f72c2-a226-4948-b86d-5156fdc719f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12d74f5-9f9f-478e-b427-6cc06486040f", "name": "network-vif-plugged", "status": "completed", "tag": "5b228077-6303-443c-8524-ef7ada123f4c"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:48.061723 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c7c497f5-8fcb-4b09-81f0-c69fa693972d req-723f72c2-a226-4948-b86d-5156fdc719f4 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:48.062457 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c7c497f5-8fcb-4b09-81f0-c69fa693972d req-723f72c2-a226-4948-b86d-5156fdc719f4 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:48.063225 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-c7c497f5-8fcb-4b09-81f0-c69fa693972d req-723f72c2-a226-4948-b86d-5156fdc719f4 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:48.085529 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-c7c497f5-8fcb-4b09-81f0-c69fa693972d req-723f72c2-a226-4948-b86d-5156fdc719f4 service nova] Creating event network-vif-plugged:5b228077-6303-443c-8524-ef7ada123f4c for instance e12d74f5-9f9f-478e-b427-6cc06486040f on hv-cinder-85221 Aug 31 00:30:48.095508 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-c7c497f5-8fcb-4b09-81f0-c69fa693972d req-723f72c2-a226-4948-b86d-5156fdc719f4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063591 Aug 31 00:30:48.096780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 536/1053] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:48.948045 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-8e7c5014-f5b4-4c27-8afc-81fac5832e9f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:48.949242 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-8e7c5014-f5b4-4c27-8afc-81fac5832e9f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:48.961758 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e7c5014-f5b4-4c27-8afc-81fac5832e9f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:48.962685 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e7c5014-f5b4-4c27-8afc-81fac5832e9f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:48.963452 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e7c5014-f5b4-4c27-8afc-81fac5832e9f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:48.964771 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e7c5014-f5b4-4c27-8afc-81fac5832e9f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:48.965636 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e7c5014-f5b4-4c27-8afc-81fac5832e9f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:48.966388 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-8e7c5014-f5b4-4c27-8afc-81fac5832e9f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:49.124387 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-8e7c5014-f5b4-4c27-8afc-81fac5832e9f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:49.133862 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-8e7c5014-f5b4-4c27-8afc-81fac5832e9f tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1313 microversion: 2.1 time: 0.193156 Aug 31 00:30:49.134714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 518/1054] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:48 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:50.153624 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:50.158708 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-2861b6a5-a52b-4e66-99b5-cfcf6cad9b55 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:50.159471 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-2861b6a5-a52b-4e66-99b5-cfcf6cad9b55 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:50.168192 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2861b6a5-a52b-4e66-99b5-cfcf6cad9b55 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:50.168872 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2861b6a5-a52b-4e66-99b5-cfcf6cad9b55 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:50.169415 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2861b6a5-a52b-4e66-99b5-cfcf6cad9b55 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:50.170240 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2861b6a5-a52b-4e66-99b5-cfcf6cad9b55 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:50.170796 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2861b6a5-a52b-4e66-99b5-cfcf6cad9b55 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:50.171321 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-2861b6a5-a52b-4e66-99b5-cfcf6cad9b55 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:50.340054 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-2861b6a5-a52b-4e66-99b5-cfcf6cad9b55 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:50.348903 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-2861b6a5-a52b-4e66-99b5-cfcf6cad9b55 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1498 microversion: 2.1 time: 0.196699 Aug 31 00:30:50.349514 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 537/1055] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:50 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1498 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:50.983807 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1f815ea9-4d49-40f9-a63b-3442fc0199ac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:50.984614 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1f815ea9-4d49-40f9-a63b-3442fc0199ac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:50.986826 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:50.987776 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=6 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:50.996429 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f815ea9-4d49-40f9-a63b-3442fc0199ac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:50.997035 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f815ea9-4d49-40f9-a63b-3442fc0199ac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:50.997542 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f815ea9-4d49-40f9-a63b-3442fc0199ac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:50.998425 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f815ea9-4d49-40f9-a63b-3442fc0199ac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:50.999056 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f815ea9-4d49-40f9-a63b-3442fc0199ac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:50.999596 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1f815ea9-4d49-40f9-a63b-3442fc0199ac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:51.029872 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1f815ea9-4d49-40f9-a63b-3442fc0199ac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:30:51.120802 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1f815ea9-4d49-40f9-a63b-3442fc0199ac tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 204 len: 0 microversion: 2.1 time: 0.141441 Aug 31 00:30:51.121565 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 519/1056] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:30:50 2022] DELETE /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:30:51.132550 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a273114b-6520-49c0-b95b-08c64d8a7978 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:51.133913 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a273114b-6520-49c0-b95b-08c64d8a7978 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:51.141425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a273114b-6520-49c0-b95b-08c64d8a7978 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:51.142064 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a273114b-6520-49c0-b95b-08c64d8a7978 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:51.142613 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a273114b-6520-49c0-b95b-08c64d8a7978 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:51.143439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a273114b-6520-49c0-b95b-08c64d8a7978 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:51.144122 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a273114b-6520-49c0-b95b-08c64d8a7978 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:51.144684 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a273114b-6520-49c0-b95b-08c64d8a7978 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:51.355382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a273114b-6520-49c0-b95b-08c64d8a7978 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:51.364820 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a273114b-6520-49c0-b95b-08c64d8a7978 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1504 microversion: 2.1 time: 0.237579 Aug 31 00:30:51.365418 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 538/1057] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:51 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:52.388195 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-53de89f3-6f73-44d1-a779-1b205b6d632c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:52.388902 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-53de89f3-6f73-44d1-a779-1b205b6d632c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:52.395865 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53de89f3-6f73-44d1-a779-1b205b6d632c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:52.396659 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53de89f3-6f73-44d1-a779-1b205b6d632c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:52.397092 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53de89f3-6f73-44d1-a779-1b205b6d632c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:52.397799 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53de89f3-6f73-44d1-a779-1b205b6d632c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:52.398636 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53de89f3-6f73-44d1-a779-1b205b6d632c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:52.399063 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53de89f3-6f73-44d1-a779-1b205b6d632c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:52.554412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-53de89f3-6f73-44d1-a779-1b205b6d632c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:52.563949 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-53de89f3-6f73-44d1-a779-1b205b6d632c tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1504 microversion: 2.1 time: 0.180101 Aug 31 00:30:52.564645 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 520/1058] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:52 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:53.211971 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-32e09217-d63b-48d1-a4e5-142a370d43bb req-05b43486-171f-4b08-b592-1a09b36c1a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12d74f5-9f9f-478e-b427-6cc06486040f", "name": "network-vif-deleted", "tag": "5b228077-6303-443c-8524-ef7ada123f4c"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:53.225498 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-32e09217-d63b-48d1-a4e5-142a370d43bb req-05b43486-171f-4b08-b592-1a09b36c1a42 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:53.225973 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-32e09217-d63b-48d1-a4e5-142a370d43bb req-05b43486-171f-4b08-b592-1a09b36c1a42 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:53.227051 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-32e09217-d63b-48d1-a4e5-142a370d43bb req-05b43486-171f-4b08-b592-1a09b36c1a42 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:53.239859 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-32e09217-d63b-48d1-a4e5-142a370d43bb req-05b43486-171f-4b08-b592-1a09b36c1a42 service nova] Creating event network-vif-deleted:5b228077-6303-443c-8524-ef7ada123f4c for instance e12d74f5-9f9f-478e-b427-6cc06486040f on hv-cinder-85221 Aug 31 00:30:53.246333 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-32e09217-d63b-48d1-a4e5-142a370d43bb req-05b43486-171f-4b08-b592-1a09b36c1a42 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039890 Aug 31 00:30:53.246861 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 539/1059] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:53.588022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:53.588709 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:53.596250 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:53.596746 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:53.597180 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:53.597908 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:53.598353 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:53.598770 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:53.635116 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:53.635718 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:53.636391 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:53.636973 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lazy-loading 'fault' on Instance uuid e12d74f5-9f9f-478e-b427-6cc06486040f {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:30:53.681864 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f5ea3b457d546b0b9c362085a90e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c60f381dfb74597b07208b0c080987f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:53.690936 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d3d45f13-9a21-4d8f-8c0b-0b1e26bf54c1 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 200 len: 1303 microversion: 2.1 time: 0.107338 Aug 31 00:30:53.691601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 521/1060] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:53 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:54.722607 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:54.723318 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] [instance: e12d74f5-9f9f-478e-b427-6cc06486040f] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:54.731195 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:54.731684 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:54.732120 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:54.732877 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:54.733333 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:54.733758 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:54.751110 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] HTTP exception thrown: Instance e12d74f5-9f9f-478e-b427-6cc06486040f could not be found. Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Request method failure captured: Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f HTTP/1.1 Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDquP0VCUDVTaBGSyOsbhUzRVPrBs7cDx46yV4bZQGEc8qAjAV56sVkKFfEqZBZg9wVfeugTvuB7m-8-a0O0aSlywKUpy9eTj0n2RCgQzNOYpT05tUH2bN_OTzJFnm5OMgA_L5J4JdcI1LDEpLmvsmq9omKotSSiadbR1Fz0OK-0EKlw Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 0c60f381dfb74597b07208b0c080987f Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-VolumesActionsTest-1497485908 Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:30:54.752865 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c60f381dfb74597b07208b0c080987f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c60f381dfb74597b07208b0c080987f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c60f381dfb74597b07208b0c080987f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c60f381dfb74597b07208b0c080987f"}]}] Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-VolumesActionsTest-1497485908 Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 0c60f381dfb74597b07208b0c080987f Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-VolumesActionsTest-1497485908 Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-VolumesActionsTest-1497485908-project Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 4f5ea3b457d546b0b9c362085a90e2ed Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-VolumesActionsTest-1497485908-project Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance e12d74f5-9f9f-478e-b427-6cc06486040f could not be found. Aug 31 00:30:54.755894 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'e12d74f5-9f9f-478e-b427-6cc06486040f'} Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e12d74f5-9f9f-478e-b427-6cc06486040f could not be found. Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:54.757385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e12d74f5-9f9f-478e-b427-6cc06486040f could not be found. Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e12d74f5-9f9f-478e-b427-6cc06486040f could not be found. Aug 31 00:30:54.760043 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:30:54.762873 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] Returning 404 to user: Instance e12d74f5-9f9f-478e-b427-6cc06486040f could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:54.762873 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c94bad60-9088-4ec8-9c18-93b27b56e166 tempest-VolumesActionsTest-1497485908 tempest-VolumesActionsTest-1497485908-project] 10.222.0.47 "GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f" status: 404 len: 111 microversion: 2.1 time: 0.036695 Aug 31 00:30:54.762873 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 540/1061] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:54 2022] GET /compute/v2.1/servers/e12d74f5-9f9f-478e-b427-6cc06486040f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:31:33.293511 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1250022698", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1127305482", "security_groups": [{"name": "tempest-secgroup-smoke-835580744"}], "block_device_mapping_v2": [{"uuid": "b2747e21-35f0-4a44-9776-b936d8b24e3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2cf33b5d-0191-49b5-9f4e-a777ce59af25"}]}} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:31:33.304861 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:33.305582 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:33.438341 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.network.neutron [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] validate_networks() for [('2cf33b5d-0191-49b5-9f4e-a777ce59af25', None, None, None, None, None)] {{(pid=127117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:31:33.947681 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Flavor limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:31:33.948108 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Image limits 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:31:33.948616 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Flavor pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:31:33.949024 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Image pref 0:0:0 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:31:33.949432 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.virt.hardware [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:31:33.959047 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:33.960045 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:33.961224 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:33.961935 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:33.962398 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:33.962827 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:33.985365 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Getting quotas for project 5e59b45c75cb4f8ea7e7a47730709614. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:31:33.992574 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.quota [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Getting quotas for user 410f2e9dc2db4ffcb5ff0f67b0d00ddc and project 5e59b45c75cb4f8ea7e7a47730709614. Resources: {'instances', 'cores', 'ram'} {{(pid=127117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:31:34.062191 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Going to run 1 instances... {{(pid=127117) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:31:34.064383 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2747e21-35f0-4a44-9776-b936d8b24e3d',volume_size=None,volume_type=None)] {{(pid=127117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:31:34.219699 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-d711a283-f98a-4d20-93cd-617570003c1d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.930425 Aug 31 00:31:34.220396 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 522/1062] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 31 00:31:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:31:34.236494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-48e07136-17b3-4b7a-9465-3ef8e81d9e14 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:34.237221 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-48e07136-17b3-4b7a-9465-3ef8e81d9e14 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:34.239769 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=23 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:34.241715 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=39 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:34.306668 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-48e07136-17b3-4b7a-9465-3ef8e81d9e14 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:34.314438 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-48e07136-17b3-4b7a-9465-3ef8e81d9e14 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1095 microversion: 2.1 time: 0.081881 Aug 31 00:31:34.315783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 541/1063] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:34 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:35.345063 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-6672a010-efb4-4c58-bfea-a1e34901e87b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:35.346221 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-6672a010-efb4-4c58-bfea-a1e34901e87b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:35.358798 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6672a010-efb4-4c58-bfea-a1e34901e87b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:35.359680 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6672a010-efb4-4c58-bfea-a1e34901e87b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:35.360579 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6672a010-efb4-4c58-bfea-a1e34901e87b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:35.361856 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6672a010-efb4-4c58-bfea-a1e34901e87b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:35.362671 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6672a010-efb4-4c58-bfea-a1e34901e87b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:35.363466 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-6672a010-efb4-4c58-bfea-a1e34901e87b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:35.435610 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-6672a010-efb4-4c58-bfea-a1e34901e87b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:35.444627 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-6672a010-efb4-4c58-bfea-a1e34901e87b tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1193 microversion: 2.1 time: 0.107279 Aug 31 00:31:35.445484 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 523/1064] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:35 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:31:36.472471 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f8016bb9-b00a-4daf-9efc-2b52750d3797 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:36.475621 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f8016bb9-b00a-4daf-9efc-2b52750d3797 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:36.488088 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f8016bb9-b00a-4daf-9efc-2b52750d3797 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:36.488965 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f8016bb9-b00a-4daf-9efc-2b52750d3797 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:36.489672 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f8016bb9-b00a-4daf-9efc-2b52750d3797 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:36.491488 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f8016bb9-b00a-4daf-9efc-2b52750d3797 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:36.492240 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f8016bb9-b00a-4daf-9efc-2b52750d3797 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:36.492926 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f8016bb9-b00a-4daf-9efc-2b52750d3797 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:36.767216 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f8016bb9-b00a-4daf-9efc-2b52750d3797 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:36.784423 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f8016bb9-b00a-4daf-9efc-2b52750d3797 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1266 microversion: 2.1 time: 0.318969 Aug 31 00:31:36.785472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 542/1065] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:36 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:37.632502 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-73cd39b5-fb51-4b59-ab2a-b1ba7cff1fbe req-fa8e4e4b-088e-464d-b5cf-21edf201d512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3e9d68-f696-4347-86c0-60d4d22a8e27", "tag": "dd4488ca-4188-4986-a93c-20f879f1f5da"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:31:37.649325 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-73cd39b5-fb51-4b59-ab2a-b1ba7cff1fbe req-fa8e4e4b-088e-464d-b5cf-21edf201d512 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:37.650348 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-73cd39b5-fb51-4b59-ab2a-b1ba7cff1fbe req-fa8e4e4b-088e-464d-b5cf-21edf201d512 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:37.651274 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-73cd39b5-fb51-4b59-ab2a-b1ba7cff1fbe req-fa8e4e4b-088e-464d-b5cf-21edf201d512 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:37.669536 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-73cd39b5-fb51-4b59-ab2a-b1ba7cff1fbe req-fa8e4e4b-088e-464d-b5cf-21edf201d512 service nova] Creating event network-changed:dd4488ca-4188-4986-a93c-20f879f1f5da for instance ca3e9d68-f696-4347-86c0-60d4d22a8e27 on hv-cinder-85221 Aug 31 00:31:37.675366 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-73cd39b5-fb51-4b59-ab2a-b1ba7cff1fbe req-fa8e4e4b-088e-464d-b5cf-21edf201d512 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249650 Aug 31 00:31:37.676320 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 524/1066] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:31:37.825390 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3fb6156b-cf0c-4ac9-b042-6b1d5d29733d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:37.826369 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3fb6156b-cf0c-4ac9-b042-6b1d5d29733d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:37.838187 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb6156b-cf0c-4ac9-b042-6b1d5d29733d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:37.839058 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb6156b-cf0c-4ac9-b042-6b1d5d29733d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:37.839856 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb6156b-cf0c-4ac9-b042-6b1d5d29733d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:37.841196 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb6156b-cf0c-4ac9-b042-6b1d5d29733d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:37.842053 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb6156b-cf0c-4ac9-b042-6b1d5d29733d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:37.842840 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb6156b-cf0c-4ac9-b042-6b1d5d29733d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:38.064490 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3fb6156b-cf0c-4ac9-b042-6b1d5d29733d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:38.073674 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3fb6156b-cf0c-4ac9-b042-6b1d5d29733d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1266 microversion: 2.1 time: 0.256533 Aug 31 00:31:38.074269 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 543/1067] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:37 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:31:39.105970 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-3b2c6c43-8770-4b9b-a6e9-a4b65481fc24 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:39.106613 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-3b2c6c43-8770-4b9b-a6e9-a4b65481fc24 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:39.113427 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3b2c6c43-8770-4b9b-a6e9-a4b65481fc24 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:39.113925 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3b2c6c43-8770-4b9b-a6e9-a4b65481fc24 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:39.114360 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3b2c6c43-8770-4b9b-a6e9-a4b65481fc24 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:39.115074 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3b2c6c43-8770-4b9b-a6e9-a4b65481fc24 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:39.116201 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3b2c6c43-8770-4b9b-a6e9-a4b65481fc24 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:39.116980 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-3b2c6c43-8770-4b9b-a6e9-a4b65481fc24 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:39.564313 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-3b2c6c43-8770-4b9b-a6e9-a4b65481fc24 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:39.578343 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-3b2c6c43-8770-4b9b-a6e9-a4b65481fc24 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1266 microversion: 2.1 time: 0.477639 Aug 31 00:31:39.579354 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 525/1068] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:39 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1266 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:40.601383 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-4dfc5f19-6c38-4995-896a-5772d00469d4 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:40.602338 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-4dfc5f19-6c38-4995-896a-5772d00469d4 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:40.609359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dfc5f19-6c38-4995-896a-5772d00469d4 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:40.609887 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dfc5f19-6c38-4995-896a-5772d00469d4 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:40.610322 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dfc5f19-6c38-4995-896a-5772d00469d4 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:40.611046 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dfc5f19-6c38-4995-896a-5772d00469d4 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:40.611498 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dfc5f19-6c38-4995-896a-5772d00469d4 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:40.611919 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-4dfc5f19-6c38-4995-896a-5772d00469d4 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:40.764695 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-4dfc5f19-6c38-4995-896a-5772d00469d4 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:40.773859 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-4dfc5f19-6c38-4995-896a-5772d00469d4 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1266 microversion: 2.1 time: 0.177256 Aug 31 00:31:40.774460 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 544/1069] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:40 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:31:41.794699 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-aa7c74ae-5ab1-4734-9ea7-f1d7ab809f30 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:41.795309 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-aa7c74ae-5ab1-4734-9ea7-f1d7ab809f30 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:41.802261 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aa7c74ae-5ab1-4734-9ea7-f1d7ab809f30 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:41.802750 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aa7c74ae-5ab1-4734-9ea7-f1d7ab809f30 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:41.803182 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aa7c74ae-5ab1-4734-9ea7-f1d7ab809f30 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:41.804020 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aa7c74ae-5ab1-4734-9ea7-f1d7ab809f30 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:41.804502 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aa7c74ae-5ab1-4734-9ea7-f1d7ab809f30 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:41.804927 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-aa7c74ae-5ab1-4734-9ea7-f1d7ab809f30 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:41.952674 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-aa7c74ae-5ab1-4734-9ea7-f1d7ab809f30 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:41.961280 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-aa7c74ae-5ab1-4734-9ea7-f1d7ab809f30 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1266 microversion: 2.1 time: 0.170494 Aug 31 00:31:41.961873 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 526/1070] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:41 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:42.982797 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-88d796d7-121c-4b1d-87f9-39cc9beff38e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:42.983439 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-88d796d7-121c-4b1d-87f9-39cc9beff38e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:42.990998 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88d796d7-121c-4b1d-87f9-39cc9beff38e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:42.991494 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88d796d7-121c-4b1d-87f9-39cc9beff38e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:42.992174 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88d796d7-121c-4b1d-87f9-39cc9beff38e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:42.992905 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88d796d7-121c-4b1d-87f9-39cc9beff38e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:42.993358 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88d796d7-121c-4b1d-87f9-39cc9beff38e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:42.993783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-88d796d7-121c-4b1d-87f9-39cc9beff38e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:43.144784 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-88d796d7-121c-4b1d-87f9-39cc9beff38e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:43.154022 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-88d796d7-121c-4b1d-87f9-39cc9beff38e tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1266 microversion: 2.1 time: 0.175210 Aug 31 00:31:43.154669 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 545/1071] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:42 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:44.175689 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-db160575-f0ac-4d70-9a0e-ad8ef53e8f8a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:44.176660 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-db160575-f0ac-4d70-9a0e-ad8ef53e8f8a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:44.180126 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=2 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:44.181856 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell0:SELECT=6 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:44.188756 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db160575-f0ac-4d70-9a0e-ad8ef53e8f8a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:44.189260 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db160575-f0ac-4d70-9a0e-ad8ef53e8f8a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:44.189801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db160575-f0ac-4d70-9a0e-ad8ef53e8f8a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:44.190554 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db160575-f0ac-4d70-9a0e-ad8ef53e8f8a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:44.191013 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db160575-f0ac-4d70-9a0e-ad8ef53e8f8a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:44.191445 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db160575-f0ac-4d70-9a0e-ad8ef53e8f8a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:44.357637 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-db160575-f0ac-4d70-9a0e-ad8ef53e8f8a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:44.371866 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-db160575-f0ac-4d70-9a0e-ad8ef53e8f8a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1266 microversion: 2.1 time: 0.200097 Aug 31 00:31:44.372980 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 527/1072] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:44 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:45.406824 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-3fb528f3-446f-4134-81b2-0bfd1917e2cf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:45.407858 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-3fb528f3-446f-4134-81b2-0bfd1917e2cf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:45.410663 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell0:SELECT=2 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:45.417128 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb528f3-446f-4134-81b2-0bfd1917e2cf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:45.417624 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb528f3-446f-4134-81b2-0bfd1917e2cf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:45.418065 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb528f3-446f-4134-81b2-0bfd1917e2cf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:45.418802 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb528f3-446f-4134-81b2-0bfd1917e2cf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:45.419256 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb528f3-446f-4134-81b2-0bfd1917e2cf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:45.419698 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-3fb528f3-446f-4134-81b2-0bfd1917e2cf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:45.574280 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-3fb528f3-446f-4134-81b2-0bfd1917e2cf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:45.583278 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-3fb528f3-446f-4134-81b2-0bfd1917e2cf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1266 microversion: 2.1 time: 0.180617 Aug 31 00:31:45.584102 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 546/1073] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:45 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:46.607717 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-2c16b031-52c4-49a3-88a0-cff3d3fe8651 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:46.608786 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-2c16b031-52c4-49a3-88a0-cff3d3fe8651 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:46.618812 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2c16b031-52c4-49a3-88a0-cff3d3fe8651 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:46.619569 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2c16b031-52c4-49a3-88a0-cff3d3fe8651 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:46.620123 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2c16b031-52c4-49a3-88a0-cff3d3fe8651 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:46.621299 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2c16b031-52c4-49a3-88a0-cff3d3fe8651 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:46.621916 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2c16b031-52c4-49a3-88a0-cff3d3fe8651 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:46.623649 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-2c16b031-52c4-49a3-88a0-cff3d3fe8651 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:46.820944 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-2c16b031-52c4-49a3-88a0-cff3d3fe8651 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:46.831754 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-2c16b031-52c4-49a3-88a0-cff3d3fe8651 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1266 microversion: 2.1 time: 0.228721 Aug 31 00:31:46.832667 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 528/1074] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:46 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:31:47.857883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-18bb79a5-e1a9-4171-acd8-f4629b318d9f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:47.858539 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-18bb79a5-e1a9-4171-acd8-f4629b318d9f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:47.866143 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18bb79a5-e1a9-4171-acd8-f4629b318d9f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:47.866713 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18bb79a5-e1a9-4171-acd8-f4629b318d9f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:47.867214 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18bb79a5-e1a9-4171-acd8-f4629b318d9f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:47.868059 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18bb79a5-e1a9-4171-acd8-f4629b318d9f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:47.868597 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18bb79a5-e1a9-4171-acd8-f4629b318d9f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:47.869071 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-18bb79a5-e1a9-4171-acd8-f4629b318d9f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:48.032606 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-18bb79a5-e1a9-4171-acd8-f4629b318d9f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:48.042717 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-18bb79a5-e1a9-4171-acd8-f4629b318d9f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1266 microversion: 2.1 time: 0.188886 Aug 31 00:31:48.043532 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 547/1075] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:47 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:48.223546 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-e40fc066-8d94-4473-9a59-6b5c20c62437 req-7c1471d1-2a7a-4971-b350-47ca41215ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3e9d68-f696-4347-86c0-60d4d22a8e27", "name": "network-vif-plugged", "status": "completed", "tag": "dd4488ca-4188-4986-a93c-20f879f1f5da"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:31:48.239050 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e40fc066-8d94-4473-9a59-6b5c20c62437 req-7c1471d1-2a7a-4971-b350-47ca41215ceb service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:48.239822 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e40fc066-8d94-4473-9a59-6b5c20c62437 req-7c1471d1-2a7a-4971-b350-47ca41215ceb service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:48.241351 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-e40fc066-8d94-4473-9a59-6b5c20c62437 req-7c1471d1-2a7a-4971-b350-47ca41215ceb service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:48.255247 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-e40fc066-8d94-4473-9a59-6b5c20c62437 req-7c1471d1-2a7a-4971-b350-47ca41215ceb service nova] Creating event network-vif-plugged:dd4488ca-4188-4986-a93c-20f879f1f5da for instance ca3e9d68-f696-4347-86c0-60d4d22a8e27 on hv-cinder-85221 Aug 31 00:31:48.262965 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-e40fc066-8d94-4473-9a59-6b5c20c62437 req-7c1471d1-2a7a-4971-b350-47ca41215ceb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043406 Aug 31 00:31:48.263580 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 529/1076] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:31:49.071397 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-c191c066-9a53-4e88-adad-bcb2cd79f8b0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:49.072054 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-c191c066-9a53-4e88-adad-bcb2cd79f8b0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:49.082031 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c191c066-9a53-4e88-adad-bcb2cd79f8b0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:49.082950 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c191c066-9a53-4e88-adad-bcb2cd79f8b0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:49.084370 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c191c066-9a53-4e88-adad-bcb2cd79f8b0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:49.085732 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c191c066-9a53-4e88-adad-bcb2cd79f8b0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:49.086592 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c191c066-9a53-4e88-adad-bcb2cd79f8b0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:49.087396 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-c191c066-9a53-4e88-adad-bcb2cd79f8b0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:49.249346 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-c191c066-9a53-4e88-adad-bcb2cd79f8b0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:49.258236 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-c191c066-9a53-4e88-adad-bcb2cd79f8b0 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1266 microversion: 2.1 time: 0.190753 Aug 31 00:31:49.258830 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 548/1077] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:49 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:50.281633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-64e602ed-8074-4714-b5ca-3082d5d62500 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:50.282286 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-64e602ed-8074-4714-b5ca-3082d5d62500 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:50.290343 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64e602ed-8074-4714-b5ca-3082d5d62500 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:50.290917 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64e602ed-8074-4714-b5ca-3082d5d62500 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:50.291448 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64e602ed-8074-4714-b5ca-3082d5d62500 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:50.292407 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64e602ed-8074-4714-b5ca-3082d5d62500 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:50.292942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64e602ed-8074-4714-b5ca-3082d5d62500 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:50.293453 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-64e602ed-8074-4714-b5ca-3082d5d62500 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:50.446653 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-64e602ed-8074-4714-b5ca-3082d5d62500 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:50.464249 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-64e602ed-8074-4714-b5ca-3082d5d62500 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1453 microversion: 2.1 time: 0.187274 Aug 31 00:31:50.465292 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 530/1078] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:50 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:50.498609 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-f61c0558-7bfd-4135-bbb5-88bc95e1ee77 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:50.499252 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-f61c0558-7bfd-4135-bbb5-88bc95e1ee77 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:50.505765 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f61c0558-7bfd-4135-bbb5-88bc95e1ee77 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:50.506772 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f61c0558-7bfd-4135-bbb5-88bc95e1ee77 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:50.507209 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f61c0558-7bfd-4135-bbb5-88bc95e1ee77 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:50.507946 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f61c0558-7bfd-4135-bbb5-88bc95e1ee77 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:50.508427 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f61c0558-7bfd-4135-bbb5-88bc95e1ee77 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:50.508856 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-f61c0558-7bfd-4135-bbb5-88bc95e1ee77 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:50.669431 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-f61c0558-7bfd-4135-bbb5-88bc95e1ee77 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:50.678712 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-f61c0558-7bfd-4135-bbb5-88bc95e1ee77 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1453 microversion: 2.1 time: 0.184382 Aug 31 00:31:50.679394 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 549/1079] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:50 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:52.671812 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-d69a691c-eeac-45a4-9e30-b381295e013d req-71fee50d-21c1-483c-90a8-88f7b7ec6454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3e9d68-f696-4347-86c0-60d4d22a8e27", "tag": "dd4488ca-4188-4986-a93c-20f879f1f5da"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:31:52.690378 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d69a691c-eeac-45a4-9e30-b381295e013d req-71fee50d-21c1-483c-90a8-88f7b7ec6454 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:52.691159 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d69a691c-eeac-45a4-9e30-b381295e013d req-71fee50d-21c1-483c-90a8-88f7b7ec6454 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:52.692066 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-d69a691c-eeac-45a4-9e30-b381295e013d req-71fee50d-21c1-483c-90a8-88f7b7ec6454 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:52.717020 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-d69a691c-eeac-45a4-9e30-b381295e013d req-71fee50d-21c1-483c-90a8-88f7b7ec6454 service nova] Creating event network-changed:dd4488ca-4188-4986-a93c-20f879f1f5da for instance ca3e9d68-f696-4347-86c0-60d4d22a8e27 on hv-cinder-85221 Aug 31 00:31:52.727289 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-d69a691c-eeac-45a4-9e30-b381295e013d req-71fee50d-21c1-483c-90a8-88f7b7ec6454 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058901 Aug 31 00:31:52.728791 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 531/1080] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:33:21.892531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-0e6649a1-35bb-497a-bee2-95038a797cd3 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:21.893594 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0e6649a1-35bb-497a-bee2-95038a797cd3 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:21.899993 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_api:SELECT=20 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:21.901335 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG dbcounter [-] [127118] Writing DB stats nova_cell1:SELECT=48 {{(pid=127118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:21.904071 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:33:21.904707 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Wed Aug 31 00:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 (ip 10.222.0.47) !!! Aug 31 00:33:21.906086 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [req-f908692a-35a0-4eaf-8653-ac932a73513d req-64747d03-bcab-484c-b546-202be39656bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3e9d68-f696-4347-86c0-60d4d22a8e27", "tag": "dd4488ca-4188-4986-a93c-20f879f1f5da"}]} {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:33:21.908184 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:33:21.908414 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Wed Aug 31 00:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 (ip 10.222.0.47) !!! Aug 31 00:33:21.912019 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:33:21.912388 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Wed Aug 31 00:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 (ip 10.222.0.47) !!! Aug 31 00:33:21.917730 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:21.919493 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG dbcounter [-] [127117] Writing DB stats nova_cell1:SELECT=44 {{(pid=127117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:21.925942 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 00:33:21.926562 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Wed Aug 31 00:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 31 00:33:21.927083 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6649a1-35bb-497a-bee2-95038a797cd3 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:21.928066 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6649a1-35bb-497a-bee2-95038a797cd3 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:21.928788 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6649a1-35bb-497a-bee2-95038a797cd3 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:21.930134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6649a1-35bb-497a-bee2-95038a797cd3 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:21.930965 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6649a1-35bb-497a-bee2-95038a797cd3 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:21.931574 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-0e6649a1-35bb-497a-bee2-95038a797cd3 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:21.947467 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f908692a-35a0-4eaf-8653-ac932a73513d req-64747d03-bcab-484c-b546-202be39656bc service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:21.948742 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f908692a-35a0-4eaf-8653-ac932a73513d req-64747d03-bcab-484c-b546-202be39656bc service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:21.949594 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [req-f908692a-35a0-4eaf-8653-ac932a73513d req-64747d03-bcab-484c-b546-202be39656bc service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:21.972125 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.compute.server_external_events [req-f908692a-35a0-4eaf-8653-ac932a73513d req-64747d03-bcab-484c-b546-202be39656bc service nova] Creating event network-changed:dd4488ca-4188-4986-a93c-20f879f1f5da for instance ca3e9d68-f696-4347-86c0-60d4d22a8e27 on hv-cinder-85221 Aug 31 00:33:21.982268 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [req-f908692a-35a0-4eaf-8653-ac932a73513d req-64747d03-bcab-484c-b546-202be39656bc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089094 Aug 31 00:33:21.984132 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 532/1081] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:33:22.001019 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-0e6649a1-35bb-497a-bee2-95038a797cd3 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Going to try to terminate instance {{(pid=127118) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:33:22.132881 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-0e6649a1-35bb-497a-bee2-95038a797cd3 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 204 len: 0 microversion: 2.1 time: 0.246381 Aug 31 00:33:22.137125 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 550/1082] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:33:21 2022] DELETE /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:33:22.143026 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-92b8370b-1255-48e7-985b-06b8a6991e9a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:22.144107 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-92b8370b-1255-48e7-985b-06b8a6991e9a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:22.151623 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92b8370b-1255-48e7-985b-06b8a6991e9a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:22.152242 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92b8370b-1255-48e7-985b-06b8a6991e9a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:22.152792 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92b8370b-1255-48e7-985b-06b8a6991e9a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:22.153572 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92b8370b-1255-48e7-985b-06b8a6991e9a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:22.154038 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92b8370b-1255-48e7-985b-06b8a6991e9a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:22.154468 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-92b8370b-1255-48e7-985b-06b8a6991e9a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:22.381716 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-92b8370b-1255-48e7-985b-06b8a6991e9a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:33:22.390384 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-92b8370b-1255-48e7-985b-06b8a6991e9a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1577 microversion: 2.1 time: 0.251688 Aug 31 00:33:22.390978 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 533/1083] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:33:22 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1577 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:33:23.415606 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-a254243e-4810-41d0-95f9-6320f91c3594 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:23.416472 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-a254243e-4810-41d0-95f9-6320f91c3594 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:23.424313 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a254243e-4810-41d0-95f9-6320f91c3594 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:23.424868 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a254243e-4810-41d0-95f9-6320f91c3594 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:23.425627 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a254243e-4810-41d0-95f9-6320f91c3594 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:23.426480 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a254243e-4810-41d0-95f9-6320f91c3594 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:23.426993 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a254243e-4810-41d0-95f9-6320f91c3594 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:23.427536 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-a254243e-4810-41d0-95f9-6320f91c3594 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:23.583724 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-a254243e-4810-41d0-95f9-6320f91c3594 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:33:23.592531 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-a254243e-4810-41d0-95f9-6320f91c3594 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1577 microversion: 2.1 time: 0.181217 Aug 31 00:33:23.593344 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 551/1084] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:33:23 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:33:24.616410 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-1d9bf66b-3507-4dc6-9059-61e0c95e0fc8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:24.617214 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-1d9bf66b-3507-4dc6-9059-61e0c95e0fc8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:24.624855 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d9bf66b-3507-4dc6-9059-61e0c95e0fc8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:24.625714 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d9bf66b-3507-4dc6-9059-61e0c95e0fc8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:24.626168 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d9bf66b-3507-4dc6-9059-61e0c95e0fc8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:24.626930 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d9bf66b-3507-4dc6-9059-61e0c95e0fc8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:24.627412 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d9bf66b-3507-4dc6-9059-61e0c95e0fc8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:24.627933 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-1d9bf66b-3507-4dc6-9059-61e0c95e0fc8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:24.962350 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-1d9bf66b-3507-4dc6-9059-61e0c95e0fc8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:33:24.975293 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-1d9bf66b-3507-4dc6-9059-61e0c95e0fc8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1577 microversion: 2.1 time: 0.363397 Aug 31 00:33:24.980230 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 534/1085] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:33:24 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1577 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:33:24.993741 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-67a11870-fce4-4009-9c84-37e3fc16c8b3 req-d98800f3-dd24-4105-83a1-ff807ebe70a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3e9d68-f696-4347-86c0-60d4d22a8e27", "name": "network-vif-deleted", "tag": "dd4488ca-4188-4986-a93c-20f879f1f5da"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:33:25.006808 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-67a11870-fce4-4009-9c84-37e3fc16c8b3 req-d98800f3-dd24-4105-83a1-ff807ebe70a4 service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:25.007620 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-67a11870-fce4-4009-9c84-37e3fc16c8b3 req-d98800f3-dd24-4105-83a1-ff807ebe70a4 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:25.008089 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-67a11870-fce4-4009-9c84-37e3fc16c8b3 req-d98800f3-dd24-4105-83a1-ff807ebe70a4 service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:25.022385 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-67a11870-fce4-4009-9c84-37e3fc16c8b3 req-d98800f3-dd24-4105-83a1-ff807ebe70a4 service nova] Creating event network-vif-deleted:dd4488ca-4188-4986-a93c-20f879f1f5da for instance ca3e9d68-f696-4347-86c0-60d4d22a8e27 on hv-cinder-85221 Aug 31 00:33:25.028116 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-67a11870-fce4-4009-9c84-37e3fc16c8b3 req-d98800f3-dd24-4105-83a1-ff807ebe70a4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038414 Aug 31 00:33:25.028780 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 552/1086] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:33:26.006358 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:26.007097 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:26.014206 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:26.014702 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:26.015365 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:26.016228 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:26.016801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:26.017241 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:26.057014 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:26.057509 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:26.057952 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:26.058409 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.objects.instance [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lazy-loading 'fault' on Instance uuid ca3e9d68-f696-4347-86c0-60d4d22a8e27 {{(pid=127117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:33:26.113837 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:33:26.126251 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-df5f6dc7-1a49-456c-8e13-b167dc93c38a tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 200 len: 1185 microversion: 2.1 time: 0.124214 Aug 31 00:33:26.126864 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 535/1087] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:33:26 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 1185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:33:27.150922 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:27.151774 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: ca3e9d68-f696-4347-86c0-60d4d22a8e27] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:27.159998 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:27.160917 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:27.161717 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:27.162485 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:27.163058 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:27.163438 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:27.180122 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] HTTP exception thrown: Instance ca3e9d68-f696-4347-86c0-60d4d22a8e27 could not be found. Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Request method failure captured: Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 HTTP/1.1 Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqqkQFZBYLl2xG06HpeUfGLO8TZSBJSmJtAD8uQEgMrD5qKnTY2EorKINya0G01pFRYAtnY4qR3o4XNja073Z-8TLcfkmho9FG5UJoeyeUNmOdF6z-1mtybAT_06IiS9JRhwdPie0RxQVcuQ1j1OB_jVtOvtwlGs_v_OIwDAaS9JM9o Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 5e59b45c75cb4f8ea7e7a47730709614 Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:33:27.181883 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5e59b45c75cb4f8ea7e7a47730709614"}]}] Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 5e59b45c75cb4f8ea7e7a47730709614 Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-TestVolumeBootPattern-239694876-project Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 410f2e9dc2db4ffcb5ff0f67b0d00ddc Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-TestVolumeBootPattern-239694876-project Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance ca3e9d68-f696-4347-86c0-60d4d22a8e27 could not be found. Aug 31 00:33:27.184425 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'ca3e9d68-f696-4347-86c0-60d4d22a8e27'} Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca3e9d68-f696-4347-86c0-60d4d22a8e27 could not be found. Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:33:27.185862 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca3e9d68-f696-4347-86c0-60d4d22a8e27 could not be found. Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca3e9d68-f696-4347-86c0-60d4d22a8e27 could not be found. Aug 31 00:33:27.188580 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:27.191395 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Returning 404 to user: Instance ca3e9d68-f696-4347-86c0-60d4d22a8e27 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:33:27.191395 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-cf593dea-8ff1-486e-b090-c9c1712b40bf tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27" status: 404 len: 111 microversion: 2.1 time: 0.038594 Aug 31 00:33:27.191395 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 553/1088] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:33:27 2022] GET /compute/v2.1/servers/ca3e9d68-f696-4347-86c0-60d4d22a8e27 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:33:30.595882 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-5f976578-3b2d-43c7-b095-e3954c7b135d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:30.607408 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5f976578-3b2d-43c7-b095-e3954c7b135d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:30.621620 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f976578-3b2d-43c7-b095-e3954c7b135d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:30.622336 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f976578-3b2d-43c7-b095-e3954c7b135d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:30.622874 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f976578-3b2d-43c7-b095-e3954c7b135d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:30.623633 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f976578-3b2d-43c7-b095-e3954c7b135d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:30.624086 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f976578-3b2d-43c7-b095-e3954c7b135d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:30.624603 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-5f976578-3b2d-43c7-b095-e3954c7b135d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:30.678173 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-5f976578-3b2d-43c7-b095-e3954c7b135d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Going to try to terminate instance {{(pid=127117) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:33:30.679340 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-302bda53-bcfe-4234-a93c-6c0dea832a0e req-9a2204f2-b3cb-4cd3-8446-7a0b5b97c75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b1b4a7-4601-4c6f-b667-25a15b25d482", "tag": "9a806204-d2a5-4045-9aff-43a374bd4e1e"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:33:30.693004 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-302bda53-bcfe-4234-a93c-6c0dea832a0e req-9a2204f2-b3cb-4cd3-8446-7a0b5b97c75f service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:30.693703 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-302bda53-bcfe-4234-a93c-6c0dea832a0e req-9a2204f2-b3cb-4cd3-8446-7a0b5b97c75f service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:30.694351 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-302bda53-bcfe-4234-a93c-6c0dea832a0e req-9a2204f2-b3cb-4cd3-8446-7a0b5b97c75f service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:30.716841 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-302bda53-bcfe-4234-a93c-6c0dea832a0e req-9a2204f2-b3cb-4cd3-8446-7a0b5b97c75f service nova] Creating event network-changed:9a806204-d2a5-4045-9aff-43a374bd4e1e for instance c3b1b4a7-4601-4c6f-b667-25a15b25d482 on hv-cinder-85221 Aug 31 00:33:30.725749 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-302bda53-bcfe-4234-a93c-6c0dea832a0e req-9a2204f2-b3cb-4cd3-8446-7a0b5b97c75f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134433 Aug 31 00:33:30.727137 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 554/1089] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:33:30.834957 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-5f976578-3b2d-43c7-b095-e3954c7b135d tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 204 len: 0 microversion: 2.1 time: 0.246007 Aug 31 00:33:30.835801 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 536/1090] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:33:30 2022] DELETE /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:33:30.850364 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-adf3488e-349d-4ff4-b626-e760d8f1161f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:30.851657 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-adf3488e-349d-4ff4-b626-e760d8f1161f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:30.863554 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adf3488e-349d-4ff4-b626-e760d8f1161f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:30.864630 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adf3488e-349d-4ff4-b626-e760d8f1161f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:30.865368 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adf3488e-349d-4ff4-b626-e760d8f1161f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:30.866635 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adf3488e-349d-4ff4-b626-e760d8f1161f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:30.867457 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adf3488e-349d-4ff4-b626-e760d8f1161f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:30.868245 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-adf3488e-349d-4ff4-b626-e760d8f1161f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:31.042473 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.policy [None req-adf3488e-349d-4ff4-b626-e760d8f1161f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:33:31.057742 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-adf3488e-349d-4ff4-b626-e760d8f1161f tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1577 microversion: 2.1 time: 0.215553 Aug 31 00:33:31.058710 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 555/1091] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:33:30 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:33:32.088871 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-db537112-3ad9-4dc8-9566-ff8c054271c2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:32.089810 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-db537112-3ad9-4dc8-9566-ff8c054271c2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:32.097357 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db537112-3ad9-4dc8-9566-ff8c054271c2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:32.097857 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db537112-3ad9-4dc8-9566-ff8c054271c2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:32.098299 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db537112-3ad9-4dc8-9566-ff8c054271c2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:32.099053 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db537112-3ad9-4dc8-9566-ff8c054271c2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:32.099515 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db537112-3ad9-4dc8-9566-ff8c054271c2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:32.099944 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-db537112-3ad9-4dc8-9566-ff8c054271c2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:32.325421 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-db537112-3ad9-4dc8-9566-ff8c054271c2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:33:32.335605 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-db537112-3ad9-4dc8-9566-ff8c054271c2 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1577 microversion: 2.1 time: 0.251007 Aug 31 00:33:32.336230 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 537/1092] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:33:32 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1577 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:33:33.148679 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [req-8285ce69-a7d3-4577-8db5-6616e8f680c0 req-abe6eb32-7b13-4946-b90a-cc9b54d6444d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b1b4a7-4601-4c6f-b667-25a15b25d482", "name": "network-vif-deleted", "tag": "9a806204-d2a5-4045-9aff-43a374bd4e1e"}]} {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:33:33.163973 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-8285ce69-a7d3-4577-8db5-6616e8f680c0 req-abe6eb32-7b13-4946-b90a-cc9b54d6444d service nova] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:33.164981 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-8285ce69-a7d3-4577-8db5-6616e8f680c0 req-abe6eb32-7b13-4946-b90a-cc9b54d6444d service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:33.165703 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [req-8285ce69-a7d3-4577-8db5-6616e8f680c0 req-abe6eb32-7b13-4946-b90a-cc9b54d6444d service nova] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:33.189015 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.compute.server_external_events [req-8285ce69-a7d3-4577-8db5-6616e8f680c0 req-abe6eb32-7b13-4946-b90a-cc9b54d6444d service nova] Creating event network-vif-deleted:9a806204-d2a5-4045-9aff-43a374bd4e1e for instance c3b1b4a7-4601-4c6f-b667-25a15b25d482 on hv-cinder-85221 Aug 31 00:33:33.198524 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [req-8285ce69-a7d3-4577-8db5-6616e8f680c0 req-abe6eb32-7b13-4946-b90a-cc9b54d6444d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056587 Aug 31 00:33:33.199386 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 556/1093] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 31 00:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:33:33.357824 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-53b86f88-de9d-4c4b-8829-480dbf713f5c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:33.358482 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-53b86f88-de9d-4c4b-8829-480dbf713f5c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:33.366189 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53b86f88-de9d-4c4b-8829-480dbf713f5c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:33.366695 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53b86f88-de9d-4c4b-8829-480dbf713f5c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:33.367133 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53b86f88-de9d-4c4b-8829-480dbf713f5c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:33.367852 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53b86f88-de9d-4c4b-8829-480dbf713f5c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:33.368334 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53b86f88-de9d-4c4b-8829-480dbf713f5c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:33.368755 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-53b86f88-de9d-4c4b-8829-480dbf713f5c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:33.460789 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.policy [None req-53b86f88-de9d-4c4b-8829-480dbf713f5c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410f2e9dc2db4ffcb5ff0f67b0d00ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e59b45c75cb4f8ea7e7a47730709614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:33:33.477072 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-53b86f88-de9d-4c4b-8829-480dbf713f5c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 200 len: 1226 microversion: 2.1 time: 0.122924 Aug 31 00:33:33.478530 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 538/1094] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:33:33 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:33:34.511737 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:34.512655 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: c3b1b4a7-4601-4c6f-b667-25a15b25d482] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:34.520223 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:34.520721 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:34.521163 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:34.521900 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:34.522376 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:34.522781 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:34.539852 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] HTTP exception thrown: Instance c3b1b4a7-4601-4c6f-b667-25a15b25d482 could not be found. Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Request method failure captured: Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 HTTP/1.1 Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqqkQFZBYLl2xG06HpeUfGLO8TZSBJSmJtAD8uQEgMrD5qKnTY2EorKINya0G01pFRYAtnY4qR3o4XNja073Z-8TLcfkmho9FG5UJoeyeUNmOdF6z-1mtybAT_06IiS9JRhwdPie0RxQVcuQ1j1OB_jVtOvtwlGs_v_OIwDAaS9JM9o Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 5e59b45c75cb4f8ea7e7a47730709614 Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:33:34.541805 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5e59b45c75cb4f8ea7e7a47730709614"}]}] Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 5e59b45c75cb4f8ea7e7a47730709614 Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-TestVolumeBootPattern-239694876-project Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 410f2e9dc2db4ffcb5ff0f67b0d00ddc Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-TestVolumeBootPattern-239694876-project Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance c3b1b4a7-4601-4c6f-b667-25a15b25d482 could not be found. Aug 31 00:33:34.544851 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'c3b1b4a7-4601-4c6f-b667-25a15b25d482'} Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3b1b4a7-4601-4c6f-b667-25a15b25d482 could not be found. Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:33:34.546907 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3b1b4a7-4601-4c6f-b667-25a15b25d482 could not be found. Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3b1b4a7-4601-4c6f-b667-25a15b25d482 could not be found. Aug 31 00:33:34.551074 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:34.554727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Returning 404 to user: Instance c3b1b4a7-4601-4c6f-b667-25a15b25d482 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:33:34.554727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-642f1c8e-8a84-48ed-ae2a-cc0beeca6e6c tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482" status: 404 len: 111 microversion: 2.1 time: 0.037244 Aug 31 00:33:34.554727 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 557/1095] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:33:34 2022] GET /compute/v2.1/servers/c3b1b4a7-4601-4c6f-b667-25a15b25d482 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:33:35.066921 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:35.067847 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.compute.api [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127117) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:35.075141 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:35.075639 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:35.076067 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:35.076817 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:35.077264 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:35.077684 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG oslo_concurrency.lockutils [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:35.094851 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.wsgi [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] HTTP exception thrown: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Request method failure captured: Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: request: DELETE /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 HTTP/1.1 Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept: application/json Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Accept-Encoding: identity Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Connection: close Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Length: 0 Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Content-Type: application/json Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Host: 10.222.0.47 Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: Openstack-System-Scope: None Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: User-Agent: python-urllib3/1.26.12 Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Auth-Token: gAAAAABjDqqkQFZBYLl2xG06HpeUfGLO8TZSBJSmJtAD8uQEgMrD5qKnTY2EorKINya0G01pFRYAtnY4qR3o4XNja073Z-8TLcfkmho9FG5UJoeyeUNmOdF6z-1mtybAT_06IiS9JRhwdPie0RxQVcuQ1j1OB_jVtOvtwlGs_v_OIwDAaS9JM9o Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Id: None Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Domain-Name: None Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Identity-Status: Confirmed Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Is-Admin-Project: True Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Id: default Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Domain-Name: Default Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Id: 5e59b45c75cb4f8ea7e7a47730709614 Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Project-Name: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Role: reader,member Aug 31 00:33:35.096601 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Roles: reader,member Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5e59b45c75cb4f8ea7e7a47730709614"}]}] Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Id: 5e59b45c75cb4f8ea7e7a47730709614 Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-Tenant-Name: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User: tempest-TestVolumeBootPattern-239694876-project Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Id: default Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Domain-Name: Default Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Id: 410f2e9dc2db4ffcb5ff0f67b0d00ddc Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: X-User-Name: tempest-TestVolumeBootPattern-239694876-project Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: method: > Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: exception: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:33:35.099778 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: action_args: {'id': 'b3f5b45e-d0c7-461b-addb-c046c9cce995'} Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:33:35.101475 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:33:35.105022 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: ERROR nova.api.openstack.wsgi Aug 31 00:33:35.108962 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Returning 404 to user: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. {{(pid=127117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:33:35.108962 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-a6615542-71a2-4874-9f87-99f282efccd8 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 404 len: 111 microversion: 2.1 time: 0.036505 Aug 31 00:33:35.108962 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 539/1096] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 31 00:33:35 2022] DELETE /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:33:35.109433 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '>' {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:35.109882 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.compute.api [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] [instance: b3f5b45e-d0c7-461b-addb-c046c9cce995] Fetching instance by UUID {{(pid=127118) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:35.117202 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:35.117783 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:35.118382 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:35.119134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Acquiring lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:35.119627 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:35.120134 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG oslo_concurrency.lockutils [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Lock "5fd1dd09-69f2-4bc1-8110-3d087c5f7a55" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:35.135601 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.wsgi [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] HTTP exception thrown: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Request method failure captured: Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: request: GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 HTTP/1.1 Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept: application/json Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Accept-Encoding: identity Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Connection: close Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Length: 0 Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Content-Type: application/json Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Host: 10.222.0.47 Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: Openstack-System-Scope: None Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: User-Agent: python-urllib3/1.26.12 Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Auth-Token: gAAAAABjDqqkQFZBYLl2xG06HpeUfGLO8TZSBJSmJtAD8uQEgMrD5qKnTY2EorKINya0G01pFRYAtnY4qR3o4XNja073Z-8TLcfkmho9FG5UJoeyeUNmOdF6z-1mtybAT_06IiS9JRhwdPie0RxQVcuQ1j1OB_jVtOvtwlGs_v_OIwDAaS9JM9o Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Id: None Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Domain-Name: None Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Identity-Status: Confirmed Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Is-Admin-Project: True Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Id: default Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Domain-Name: Default Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Id: 5e59b45c75cb4f8ea7e7a47730709614 Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Project-Name: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Role: reader,member Aug 31 00:33:35.137359 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Roles: reader,member Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5e59b45c75cb4f8ea7e7a47730709614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5e59b45c75cb4f8ea7e7a47730709614"}]}] Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Id: 5e59b45c75cb4f8ea7e7a47730709614 Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-Tenant-Name: tempest-TestVolumeBootPattern-239694876 Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User: tempest-TestVolumeBootPattern-239694876-project Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Id: default Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Domain-Name: Default Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Id: 410f2e9dc2db4ffcb5ff0f67b0d00ddc Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: X-User-Name: tempest-TestVolumeBootPattern-239694876-project Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: method: > Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: exception: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:33:35.144210 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: action_args: {'id': 'b3f5b45e-d0c7-461b-addb-c046c9cce995'} Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: {{(pid=127118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:33:35.145267 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. Aug 31 00:33:35.146932 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: ERROR nova.api.openstack.wsgi Aug 31 00:33:35.148867 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: DEBUG nova.api.openstack.wsgi [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Returning 404 to user: Instance b3f5b45e-d0c7-461b-addb-c046c9cce995 could not be found. {{(pid=127118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:33:35.148867 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: INFO nova.api.openstack.requestlog [None req-b8652713-574b-4dcf-937c-799bbc179060 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995" status: 404 len: 111 microversion: 2.1 time: 0.035298 Aug 31 00:33:35.148867 dv-cinder-852210-5-iscsi devstack@n-api.service[127118]: [pid: 127118|app: 0|req: 558/1097] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 31 00:33:35 2022] GET /compute/v2.1/servers/b3f5b45e-d0c7-461b-addb-c046c9cce995 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:33:36.540653 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: DEBUG nova.api.openstack.wsgi [None req-4dd42220-0717-4c99-8aaa-1407dbd1c7a6 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] Calling method '.version_select at 0x7f1a3a9655e0>' {{(pid=127117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:36.573499 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: INFO nova.api.openstack.requestlog [None req-4dd42220-0717-4c99-8aaa-1407dbd1c7a6 tempest-TestVolumeBootPattern-239694876 tempest-TestVolumeBootPattern-239694876-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1127305482" status: 202 len: 0 microversion: 2.1 time: 0.037410 Aug 31 00:33:36.574793 dv-cinder-852210-5-iscsi devstack@n-api.service[127117]: [pid: 127117|app: 0|req: 540/1098] 10.222.0.47 () {58 vars in 1263 bytes} [Wed Aug 31 00:33:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1127305482 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)